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ABSTRACT 

During the 1960-1970 school year, the Cleveland 
Public Schools began implementing a More Effective Schools ifSBS) 
Program in two elementary buildings. This report is the evaluation of 
the third year of operation of the program (1971-72 school year) . The 
MES Program was designed to attack the poor achiev^ent patterns of 
inner-city children through the alteration of organizational and 
instructional patterns across all grades within a given school. 
Unlike many coiiQ>ensatory education programs that are designed to 
serve those children with the greatest need within a given subject 
area, the thesis of MES is that all inner-city children have pressing 
educational needs, and that efforts to improve the performance of 
these children in school requires a comprehensive approach that 
involves all children in all grades. The rationale behind the program 
is that: (1) learning will be facilitated if the school services and 
staff are organized and coordinated to give priority to the 
individual needs of each child, and (2) teachers *»ill teach 
effectively if they are given the time, the freedom from non-teaching 
duties, the necessary supportive personnel, and the variety of 
materials needed for more individualized instruction. The MES Program 
grew out of the meetings of a committee composed of representatives 
of the Cleveland Teachers Union and the Cleveland Board of Education. 
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MORE HFFKCTIVIi SCHOOLS PROGRAM 

INTRODUCTION 

During the 1969-70 school year, the Cleveland Public Schools 
began implementing a More Effective Schools (MES) program in two 
elementary buildings. This report is the evaluation of the third year 
of operation of the program (197U72 school year). 
A. Needs and Rationale 

The MES Program was designed to attack the poor achieve- 
ment patterns of inner-city children through the alteration of 
organizational and instixictional patterns across all grades within 
a given school. Unlike many compensatory education programs that 
are designed to serve those children with the greatest need within 
a given subject area, the thesis of MES is that all^ inner-city 
children have pressing educational needs and that efforts to improve 
- the performance of these children in school requires a comprehensive 
approach that involves all children in all grades. The rationale 
behind the program is that (1) learning will be facilitated if the 
school services and staff are organized and coordinated to give 
priority to the individual needs of each child, and (2) teachers will 
teach effectively if they are given the time, the freedom from non- 
teaching duties, the necessary supportive personnel, and the variety 
of materials needed for more individualized instruction. 

The program seeks to create optimal conditions for both 
learning and instruction hy increasing the individualization of 
instruction through the following means; 



• Reduced class size 

. Expanded instructional and supportive 
staff 

• Expanded supplemental services 

• In-service development of teachers 

• Increased instructional materials and 
equipment 

• A team approach to instruction 

• Increased parental involvement in the 
schools 

!• Objectives 

The objectives of the MHS Program fall into the two 
broad categories of process objectives and product objectives. 
Process objectives are those objectives related to the implementation 
of the propramnatic ingredients of the project. Product objectives 
are those objectives related to the expected outcomes or results of 
the implementation of the ingredients. Product objectives may be 
conceived of on two levels: (a) Staff product objectives are 
changes in teacher and administrator behavior which are expected to 
result from the implementation of the process and which may be 
. viewed as initial products, (b) Pupil product objectives are 
changes in pupil behavior which arc expected to result from the 
changes in staff behavior and which may be viewed as the final 
product . 
a. MES Process Objectives 

(1) A pre-service orientation program of two days duration 
covering the rationale, objectives and methods of the 
program will have been completed by each teacher and 
aide prior to the opening day of school. 

(2) All proposed instructional and library equipment will 
have been ordered prior to the opening day of school. 

(3) All proposed supportive personnel will have been re- 
cruited, assigned and scheduled by the opening day 
of school. 
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(4) Class registers will have been reduced to an averape 
of no greater than 25 pupils by the opening dav of 
school. 

• 

(5) The classes at each grade level will be organized into 
a cluster with a cluster team conposed of the homeroom 
teachers from the classes in the cluster, therr aides, 
and one extra teacher, 

(6) Regular weekly time slots for cluster team planning 
meetings will have been scheduled by the opening day 
of school. V/eekly planning meeting's will be held 
throughout the year. 

(7) In-service training activities covering interaction 
analysis, microteaching techniques, the use of new 
equipment, effective use of teacher aides, writing 
behavioral objectives, and test construction will be 
organized and scheduled. Time will be scheduled for 
teachers to attend these activities and teachers will 
attend regularly. 

b. Staff Product Objectives 

(1) Classroom observers will find the degree and the variety 
of ways in which instructional equipment, games and 
materials are used in the MES classrooms significantly 
greater than in Control scliools. 

(2) Classroom observers will find teacher organization and 
preparation of lessons significantly superior to that 

^ of teachers in Control sdiools. 

(3) Classroom observers will find the degree of individual 
attention to students in MES classrooms significantly 
greater than in Control schools. 

(4) Teacher questionnaires will reveal that teachers in 
MHS schools spend significantly less time pcrfonrdng 
non-teaching duties than before the program. 

(5) Project records will show the incidence of home 
visitation, open houses, parent-teacher meetings and 
other efforts to involve the parents in the education 
of their children to be significantly higher than in 
Control schools. 



• 3 • 



c. Pupil Product Ohjectivcs 

(1) Pupils in MKS schools \dll evidence achievement levels 
in reading and arithmetic which arc significantly 
greater than the levels registered at Control schools. 

(2) Attendance rates at MBS schools will increase 
significantly beyond the previous five-year average 
in those schools. 

(3) The incidence of parent- teacher meetings will increase 
beyond previous levels, as measured by project records 
and teacher questionnaires. 

(4) Pre and post administrations of locally constructed 
attitude scales will indicate that student attitudes 
toward school liave improved in MHS schools to a 
significant ly greater degree than in Control schools. 

B. Historical Background 

The More Effective Schools Program grew out of the 
meetings of a committee composed of representatives of the Cleveland 
Teachers Union and the Cleveland Board of Education. Planning for 
the implementation of the concept involved meetings of representatives 
of the two schools, the Directing Principal of the South District, 
the Assistant Superintendent in charge of curriculum and the Division 
of Research and Development. The detailed plans for each school 
were based on recommendations of committees from each school com- 
posed of the principal and teachers representing each grade level. 

The evaluation reports for Year 1 (1969-70) and Year 2 
(1970-71) of program operation revealed the following findings: 

In Year 1 the program ingredients were judged incompletely 
implemented in that there were gaps between proposed and 
actual staffing patterns, delays in the arrival of staff, 
materials and equipment, a lack of in-service training, 
and confusion on the part of the staff as to the purpose 
of the program after the prc-service orientation session. 

In Year 2 notable improvement was made in implementation 
in that all elements of the projffam were provided as 
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proposed with the exception of in-service training in 
which several previously identified areas of need were 
not addressed* 

2. In Year 1 comparisons of the perfomances of f!KS and Control 
teachers during Year 1 indicated that MES teachers provided 
wore individual attention to students, exhibited nore 
creativity in teaching, spent less tine on non-teaching 
duties, and made substantial prr press in increasinn their 
contacts with parents. However, the results also showed 
that there was no difference between MHS and Control schools 
in the use of media in instruction and that teachers in 
Control schools had better prepared and organized lessons. 
Further evidence indicated that there was little difference 
between the teaching in Ml:S and Control schools. Althouph 
the MI:S teachers expressed a generally positive attitude 
toward the propran, there was evidence of a considerable 
lack of intra-staff cooperation and ability to make effective 
use of the program ingredients. 

In Year 2 comparisons of teacher performance indicated that 
MES teachers continued to show greater individual attention 
to students, less time spent on non-teachinp duties, and 
further progress in increasing their contact with parents. 
Further, MKS classrooms were judged as having a more re- 
ceptive and comnunicative atmosphere, and MHS children show* 
ed a higher frequency of participation in lessons and of 
volunteering questions and answers. IJowever, there was no 
difference observed between MliS and Control classrooms in 
the use of media in instruction, organization and preparation 
of lessons, interest and enthusiasm generated by the lessons, 
and general teaching style in terms of organization and 
presentation of material. Teachers continued to express 
generally positive attitudes toward the program, but gaps in 
communication and lack of intra-staff cooperation were still 
problems. 

3. In Year 1 the operation of the clusters was judged to be 
generally ineffective with a tendency for teachers to work 
alone rather than together and a failure to take full 
advantage of opportunities afforded by the program ingredients. 

In Year 2 there was a greater tendency for MES teacher to 
work togetlier. Three out of the 11 clusters were judged to 
have well organized, smoothly functioning teaching and plan- 
ning teams, but most others still showed a lack of adequate 
joint planning and cooperation. 

4. In Year 1 flES children scored higher than Control children 
on the post test administrations of the Stanford Achievement 
Tests at two out of three grade levels. At Grade 2 the MES 
children scored significantly higher than Control children 
on each of two reading subtests and on one of the two math 



• 5 • 



subtests administered. At Grndc 4 the MliS children 
scored Jiijjher than the Control children on one of the two 
reading subtests and on all three of the natli subtests 
administered. At Grade 6 there were no si;»nificant dif- 
ferences between the performances of MI:S and Control cliildrcn 
on any of the two reading subtests and three math subtests 
administered. 

yg'^^r 2 MHS children continued to score higher than Control 
Children, although the focus of MliS superiority shifted from 
the middle and lower grade levels to the middle and upper 
grade levels. At Grade 1 MES children scored higher than 
Control children on one of two reading subtests. At Grade 3, 
MES children scored higher on both reading subtests administered 
and on one of the two math subtests. At Gzade 5 MRS children 
scored higher on both reading subtests administered and on two 
of the three math subtests. 

Longitudinal analysis showed that Grade 3 children who had 
been in the MHS program for two full years scored significantly 
higher than Centre' children on both reading sui)tcsts but on 
neither of the two . th subtests. Grade S children in the 
longitudinal analysx, scored significantly higher than Control 
children on botJi reading subtests and on all three math subtests. 

Cross sectional analysis of achievement data showed that third 
and fifth graders in the Mns schools performed better on 
achievement tests tJian the third and fifth graders in tlie sane 
schools the year before the program began. 

In Year 1 the results of the analysis of school attendance 
data showed that during the first yeir of operation the 
attendance rates for both MKS and Control schools declined 
from the average of the previous four years, with the Control 
schools maintaining a higher rate of attendance than the flHS 
schools both before and after the inception of the program. 

In Year 2 the attendance rates in both MliS and Control schools 
again declined. The Control schools maintained a higher rate 
of attendance. 

In Ye^ir 1 the reaction of most parents to the program was 
positive, and at one school the parent turnout at open house 
and participation in school activities was characterized as 
greatly improved over previous years. 

In Year 2 parent questionnaires and project records indicated 
tnat parent reaction to the program continued to be positive 
and that parent involvement in school activities increased. 
Many parents requested more involvement, however. 

In Year 1 analysis of attitude data showed that during Year 

1 the pro^rnn appeared to have a* positive effect on 
childrcns* attitudes toward certain aspects of school. 



specifically toward their class and the school library, 
two aspects of school directly touched by the procran. 
The only other concept for which there were consistent 
differences between MHS and Control schools was attitude 
toward the principal, in which the Control children showeci 
a consistently hipher attitude than ftns children. Where 
positive attitude change was found, it was nost obvious 
at the lower ^trades* 

In Year j analysis of attitude data showed that the MRS 
children maintained neither the norc positive attitude 
toward certain school concepts nor the more positive pain 
in attitude that they had demonstrated during Year 1. In 
fact^ Control children demonstrated generally more 
positive attitudes* 

C. Summary of Current Operations 
1# Population Served 

In Year 3 the MES ProRram operated in the same two 
elementary schools^ Alfred A. Benesch and Wooldridge. All 
students in Grades K-6 received the services of the program. 
In the third year of operation, Alfred A. Benesch had a 
student population of 512 and WooldridRe served 254 students 
for a total of 766 students. 
2. Program Costs 

The cost of the MES program has increased over three 
years of operation. Table 1 presents expenditure data. The 
table shows that over the course of three years the per pupil 
expenditure from ^ffiS funds alone increased 88%, general fund 

Table i 



Expenditure Data Over Three Years of the MES Program 



Procran 
Year 


Total MES 
Funds 


Per Pupil Hxpcnditure 


MES 


General 
Fund 


Total 


1 


$319,810 


$367 




$459 


$ 826 


2 


$4S2«170 


$557 




$501 


$1,058 


3 


$528,257 


$690 




$541 


$1,231 



expenditures increased by 18^*, and the total per pupil 
expenditure in the project schools increased 49%, It should 
be noted that some, although by no means all, of the increase 
in MES per pupil expenditures over the course of three years 
was due to salary increases and the addition of personnel and 
services that were budgeted for Year 1 but not provided. In 
Year 3 the addition of ?(ES funds to the general funds normally 
spent increased the per pupil expenditure in the project schools 
by 128%. 

Questions to be Answered by Evaluation 



The evaluation was addressed to four basic questions: 



a. Increased use of media 

b. Superior organization and 
preparation of lessons 

c. Greater degree of individual 
attention to children 

d. Less tine spent in non<> teaching 
duties 

e. Greater degree of parent*teacher 
contact 

3. Were the pupil objectives attained? 

a. Superior performance on 
achievement measures . 

b. Improved attendance rate 

c. Greater parent involvement 

d. Improved attitude toward school 

4, What has been the impact on achievement over 
the three years of operation of the program? 



1. 




2. 
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UinHLIGmS OF FINDlNnS 

A, Sm:wnar>^ of Key Findinns 

1. Uvaluation Question 1; Were the Basic Inprcdicnts of the ' 
Program Proviciod as ProposcdT ' " ~ 

FINDING: All of the proposed resources of the program' were 
provided as proposed . 

a, A pre-service orientation session was held as proposed, 
except that it was held for two rather than three days. 

Equipment and materials were ordered as proposed . 

c. Kith five exceptions all of the 72 proposed personnel 
changes were provided as proposed, 

d. Class size was reduced to an average of not over 25 pupils 
as proposed. 

€• The classrooms in MES schools were organized into clusters 
as proposed. 

f. The team of teachers serving each cluster met weekly for 
joint planning as proposed. 

g. An in-service course for teachers was conducted as proposed, 
although previously identified needs were not completely 
addressed. 

2. Evaluation Question 2: How Successful were the School Staff in 
Making Use of the Inrrcdients of the Program? 

FINDING: All five staff objectives were achieved. In addition 
MES teachers were found to be more successful in 
jnaking effective use of program resources than in 
previous years. Serious problems in the areas of 
staff conflicts and communication still exist. 

a. Staff Objectives 

(1) Classroom observers found a statistically significant 
difference in favor of the te«ic!iers in MES schools in 
the extent and effectiveness of the use of teaching 

<,aids. 

(2) Classroom observers found a statistically significant 
difference in favor of teachers in MES schools in 
the organization and preparation of lessons. 



(3) Classroom observers found a statistically 
significant difference in favor of teachers 
in MES schools in the degree of individual 
attention given .to students « 

(4) Responses to a teacher questionnaire indicated 
that ms teachers spent significantly less 
time in the performance of non*teaching re- 
latcd duties than they did before the program 
began* 

(5) Teacher logs revealed a successful effort on 

the part of MES teacliers to increase their contacts 
with parents. However, a review of the duties of the 
home-*curriculum specialist and the community aide 
is needed* 

Other Areas of Teacher Performance 

With respect to other areas of teacher performance, 

ratings by classroom observers showed that: 

(1) MES teachers were rated significantly higher than 
Control teachers on 8 out of 12 measures of 
teacher performance in the classroom* 

(2) MES teachers were judged as not inherently superior 
to Control teachers in overall quality of teaching 
but were judged to be able to do a more effective 
job because of the resources provided by the program* 

Student Response to Teacher Performance 

In rating the response of the students to the 

teachers* classroom performance, the observers* ratings 

showed that: 

(1) There was no difference between MES and Control 
schools in the interest and enthusiasm of the 
students or in the proportion of students vol- 
unteering answers to teacher questions* . 

(2) MES schools were rated significantly higher in 
terms of student participation in lessons and 
in the proportion of students raising 
spontaneous questions « 



Operation of the Cluster 



With respect to the operation of the cluster, 
the observers reports and ratings showed the following: 

(1) There was a substantially greater frequency of 
interchange of students among classrooms in MES 
schools than in Control schools* 

(2) There was a substantially greater degree of 
grouping children for instruction within class** 
rooms in flES schools than in Control schools. 

(3) The tendency for HKS staff to wdrk together in 
the classroom remained improved over the first 
year of program operation* 

(4) The organization and use of extra staff in the 
classroom was rated as effective in a sub- 
stantially greater proportion of HES class- 
rooms than Control classrooms* 

(5) With some exceptions the cluster meetings in 
MES schools were judged as productive and 
valuable to the teachers. 

(6) Six out of the 11 clusters in the MES schools 
were subjectively rates as *'good" in their 
overall operation^ 

Use of Teacher Aides 

(1) The use of teacher aides was judged as productive 
in most MES classrooms. 

(2) In-service training was suggested for teachers in 
the effective use of paraprofessionals* 

Teacher Opinion of Program Operation 

Analysis of MES teachers* responses to a question<> 

naire on various aspects of program operation indicated 

the following: 

(1) The teachers were satisfied with most elements 
of program operation* 

(2) Teachers perceived the most valuable aspects of 
the program to be small classes, the cluster 
approach, and individualization of instruction* 



(3) Substantial proportions of teachers saw a need 
for improvement in the following: 

• Training of teacher aides 

• Accessibility of supplies 

• Provision of planning time 

• In-service training 

• Teacher involvement in decision 
making 

• Communication among teachers, 
administrators and liaison personnel 

(4) According to the teachers, the major problems 
facing the program were the following: 

(a) Communication and cooperation among teachers, 
administrators and liaison personnel 

(b) Selection of staff who are willing to put 
forth the effort and commitment needed for 
program success 

(c) Administrative and liaison leadership 

(5) Teachers 'overall attitude toward the ffES Program was 
positive but a majority indicated a need for program 
modification. 

Evaluation Question 3; Were the Pupil Objectives Attained? 

FINDING: Two out of three pupil objectives were at least 
partially attained and one was not. Data on the 
fourth objective are incomplete. 

Objective 1: MES Superiority in Achievement in Reading 
and MathT 

A symmary of the results of the Stanford Achieve- 
ment Tests administered to MES and Control children in 
Grades 2, 4 and 6 in Year 3 are summarized in Table A. 
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Table A 

Summary of Results of Achievement Testing in Year 3 



SUPERIOR nUOUP ON HACH READING AND MATH SUBTEST 



Grade 


Word 
Meaning 


Paragraph 
Meaning 


Arithmetic 
Computations 


Arithmetic 
Concepts 


Arithmetic 
Applications 


2 


MES 


None 


MES 


MES 




4 


None 


None 


None 


MES 


None 


6 


MES 


None 


Control 


MES 


None 



(1) Reading 



, MES children scored higher on one out of two reading 
subtests at Grades 2 and 6, and none out of two at 
Grade 4» Perfoinnance in reading was comparatively 
worse than in the previous year when ^^ES children 
scored higher on both reading subtests at two grade 
levels and on one subtest at the remaining grade 
level • 

(2) Math 

MES children scored higher on two out of two math 
subtests at Grade 2 and one out of three at grades 
4 and 6. 

(3) The achievement results indicate that Objective 1 
was partially attained. 

b. Objective 2; Significant Increase in Attendance Rates 
in MES Schools^ 



Analysis of attendance data collected for the 
three years of program operation and for the four years 
prior to program implementation showed the following: 

(1) Attendance rates both city-wide and in the MES 
schools were significantly lower in the third year 
of operation than before the program began. 

(2) There was no evidence that the MES Program has had 
any effect on the attendance rates in the schools 
served • Objective 2 was not attained* 
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objective 3; Increase in Incidence of Parent^Teacher 
Meetings" ^ — ~ 

Data collected through teacher logs of parent 
attendance at cluster activities and records of parent at- 
tendance at schooUwide activities showed the following: 

(1) Clusters conducted an average of twc to three 
parent involvement activities per cluster during 
the year, 

(2) Parent attendance at cluster activities aver.'^ged 
approximately 48% of the possible participants 
at Benesch and 20% at Wooldridge. 

(3) The most successful school-wide activities in 
terms of parent attendance were open houses. 
The activities drawing the fewest parents 
were PTA meetings.- 

(4) Available data indicate partial achievement 
of Objective 3. 

^« Objective 4; MES Superiority in Attitude Toward School 

Data analysis was incomplete as of this writing. 

Results will be appended at a later date. 

Evaluation Question 4; What has been the impact on Acliievement 
Levels over the Three Years of Operation of the Program? ~ 

FINDING: The results of longitudinal analyses are less im- 
pressive than in the previous year, but cross 
sectional analyses showed some evidence of a 
gradual rise in performance levels at certain grades. 

a. Longitudinal Analysis 

Samples of children were selected who had been 
in the ^IES and Control schools for the entire three years 
of operation of the program. These children were compared, 
for differences in achievement levels at the end of the 
three years. Three samples were tested: 

. Grade 1-2 sample.- Children entered program in 
Grade 1, Year 2 and were compared in Grade 2 
Year 3. 
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. Grade 2-3-4 sample - Children entered program 
in Grade 2, Year 1 and were compared in Grade 
4, Year 3. 

. Grade 4-S-6 sample - Children entered program 
in Grade 4, Year 1 and were compared in Grade 
6, Year 3. 

Table B shows a summary of the results of the achievement 
comparisons made between MES and Control children in the 
longitudinal samples. 

Table B 



Summary of Results of Longitudinal Achievement Comparisons 

Between MES and Control Children 




'Longitu- 
dinal 
Sample 




SUPERIOR G 


ROUP ON EACH READING AND MATH SUBTEST 


Word 
Meaning 


Paragraph 
Meaning 


Arithmetic 
Computations 


Arithmetic 
Concepts 


Arithmetic 
Applications 


Gr. 1-2 
Gr. 2-3-4 
Gr, 4-S-6 


None 
None 
MES 


None 
None 
MES 


MES 
Control 
None 


MES 
None 
None 


Control 
None 



(1) Reading 



Of the three longitudinal samples tested the only 
significant differences in reading occurred in the 
Grade 4-5-6 sample in which MES children scored 
significantly higher on two out of two subtests 
administered in Grade 6 at the end of three years. 
This is comparatively worse than the performance in 
Year 2 when MES children scored higher on two out 
of two reading subtests in both longitudinal samples. 

(2) Math 

Of the three longitudinal samples tested, the only 
significant differences in favor of MES occurred in 
the Grade 1-2 sample in which NIES children scored 
higher on both. math subtests administered. This 
performance is somewhat poorer than in Year 2 when 
MES children scored higher on three out of three 
subtests in one of the two longitudinal samples 
tested. 
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b. Cross Sectional Analysis 

Analysis of the changes in performance levels 
across three years at given grade levels in ms schools 
revealed the following: 

(1) Reading 

Of the three grade levels examined (Grades 3, 5 and 6), 
performance levels in reading were observed to be 
gradually rising at Grades S and 6 in the face of 
generally declining performance in other schools. 

(2) Math 

Of the three grade levels examined, performance levels 
in math were observed to be gradually rising at Grade 
6 in the face of generally declining performance in 
other schools* 

(3) Despite gradual rises in performance levels at 
certain grade levels, overall performance was still 
well below grade level norms in most cases. 

B. Implications and Recommendations 
1. Discussion of Results 

This report is the evaluation of Year 3 of the MES Program, 
but any discussion of results must be undertaken in the context of 
the preceding two years of operation. During the first year of the 
program, implementation of the proposed changes in school organiza- 
tion and procedures must be characterized as less than smooth. (One 
wag was heard to remark at the time that an accurate definition of 
the program could be had simply by adding another S to the acronym.) 
Cluster operation during the first year was generally rated as in- 
effective, and teachers were judged as not making productive use of 
program resources. Effective use of new equipment and materials 
was observed infrequently, and the small class size was not seen to 
be of much benefit in most lessons observed. However, when the pro- 
gran first began few people involved really quite understood their 

• 16 - 



roles in j't, how they were expected to use its resources, the pur- 
pose, structure and function of clusters, or in short, what the 
program was . A frequently encountered question fron confused and 
■frustrated teadiers was, "...But what is^ MES?" Teachers thrown 
together on a cluster "team" tended to isolate themselves from 
their "tearanatcs" and continued to function as individual teachers 
in individual classrooms, because they did not know how to do other- 
wise, and they weren't really sure of what the otherwise, was. 

In many respects, there has been marked improvement in 
program operation since its inception. By the third year over 
half of the clusters were rated by observers as having a "good" 
overall operation, tms teachers were rated as superior to Control 
teachers on many dimensions of teaching behavior, ranging from 
better prepared and organized lessons to using a wider variety of 
methods and materials. This superiority was directly related by 
observers to the greater resources available to then. MHS 
teachers were also observed to be^^orking together as teams to a 
much greater extent, grouping and regrouping children within and 
among classrooms for instruction. More effective use of instructional 
equipment was seen, and in the majority of lessons observed, the 
loss of the smaller class size would have seriously impeded the 
effectiveness of .instruction. 

Overall, the throe years of the MKS Trogran have seen a 
gradual movement from an operation that was confused and lacking 
in definition, with an abundance of equipment^ materials^ snail clas- 
ses and supportive personnel that few teachers knew how to use, to 
an operation that is more clearly defined in terns of organiz«ition 
and procedure^ with a staff that has shown considerable growth in 
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terns of undcrs t«nndinc how to use prof;ran resources* Some measure 
of the improved understanding of the staff regarding how the pre* 
gram was intended to operate is: reflected in the changing nature 
of the conplaints teachers have made over the three years. In 
the first year teacher concerns centered most often on thinfs: not 
enough equipment, not enough ..?ttorials, not enough staff. By tlie 
third year, their .attention had shifted away from such surface 
elements to a primary concern with selecting staff with the 
philosophy and commitment necessary to make the program work. To 
one who has observed the program from the beginning, the shift 
represents a growing insight on the part of the teachers that 

showering a. school with material goodies will affect teaching 
only to the extent that teachers make effective use of them. 

Although there has been considerable improvement in 
program definition and effective use of resources, certain pro* 
blems have remained since the program began, including lack of 
communication and cooperation among teachers and school and 
program administrators, teacher dissatisfaction with the com* 
mitment of teachers selected for the program, teacher dissatis* 
faction with program leadership, and teacher dissatisfaction with 
the extent of their involvement in decision making. These are 
issues identified by the MHS teaching staff themselves, and aU 
though th^ did not « appear overwhelming, they were mentioned with 
sufficient frequency to warrant consideration. With respect to 
lack of cooperation, it sitould be noted that this problem does 
not appear as serious as in previous years; the findings of 
classroom observers certainly indicated a greater tendency for 
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teachers to work together than in the past. The problems of 
coBBunication, program leadership, staff selection and 
teacher input, however, appear nore widespread. 

It is possible, of course, that in any program that re- 
quires a high degree of teamwork and which also touts freedom 
and flexibility in teaching there will inevitably be disagreement 
and conflict. It is also possible that there is no more of a 
problem in this respect in the MliS scliools than in any other 
school, but that it is wore visible in the ^!ES schools simply be- 
cause program 'evaluation has given the teachers an opportunity to 
speak out on such issues. Whatever explanations can be devised, 
however, the distinct possibility remains that tJie degree of conflict 
and dissatisfaction that exists among the Mns staff could be a 
serious impcdiraent to the success of the program. Just as pro- 
gram administrators have taken steps in the past to clarify pro- 
gram organisation and procedures, so should they now address them- 
selves to these problems. 

Although progress in the implementation of the MlIS Pro- 
gran has been docitnented, the question renains as to its effect cn 
the children it serves. TJiree indices have been taken each year of 
operation: attendance, attitude and achievement. First, with 
respect to attendance, the evidence to date indicates that the 
MBS Program has had no effect on the attendance rates in the schools 
served. Second, attitude data during the first year showed some 
evidence that MES diildren had Eiore positive views of certain 
aspects of school than Control cliildrcn, but during the second year 
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the Control children appeared to have generally aore positive at- 
titudes. (Attitude data for Year 3 are not yet cora>lcte but will 
be appended at a later date.) Ur^uy, the effect of the progr^, on 
ichievewent levels remains to be considered. 

After three years of operation, the question "lias the 
MES procram ]iad « neasurable impact on improving achievement levels 
in reading and math?" must be answered with a resounding, "...Perhaps. 
Ourinp the first two years, MES djildren demonstrated a 
decided superiority in achievement over Control children. Analysis 
of the performance of just those children who had been in the pro- 
gran for the full two years (the longitudinal samples) showed even 
wore impressive results, m the third year of operation, however, 
there was slippage. MES children still outperformed Control diild- 
rcn on several tests, but not as many. Analysis of longitudinal 
data showed fms superiority in fewer instances than before 
and Control superiority in a few more. Cross-sectional analysis 
of dianges in performance over time at given grade levels did show 
stmt evidence of a gradual improvement in certain instances, but 
performance was still well below norm levels. 

Do the results of Year 3 indicate that the program is a 
failure? Ko - just as the results of the. first two years were not 
Interpreted as indicating an unqualified success. (Earlier reports 
cautioned against premature expansion.) The results do point up 
the difficulty in making definitive statements about the impact 
of an experimental treatment that has been in place over a rel- 
atively short period of time and which. has operated in the face of so 
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Mny uncontrollable variables as arc found in public school 
systens. Tlie problem of the possible bias introduccU by the neces* 
sity of restrict inn longitudinal samples to the tK>st geographically 
stable students in schools with iiigh inability rates has been dis- 
cussed in the text* Conducting valid cross sectional analyses of 
progran effects across time at given grade levels is harnperM by a 
lack of adequate baseline data due to changes in instrumentation* 
The differences between performance as ineasured by the CTDS and 
perfomance as measured by the Stanford serve to point up the caution 
with which such results imist be interpreted. Changing neighborhoods 
results in changing sdiool populations in both flKS and Control 
sdioolSy and the ciiangcs may not be parallel* Such changes can» 
however, affect achievetnent levels *ind the results of comparisons* 
The point of all this is that evaluation under such con* 
ditions, especially with programs involving entire school popula* 
tions, often cannot yield quick answers. It may be that the 
achievement results in Year 3 of the MBS program are merely a ripple 
in tlie stream of progress, to coin a cliche'I Or it may be that 
they reflect a continuing downward trend. The answer will come, 
but it will require time for enough data to be collected so that 
administrators will be able to say, despite fluctuations in per* 
formance, that the overall trend indicates that the program is or 
is not effective in raising achievement levels. 



2 • Kccommenda t ions 



a. It is recoiTincndeil that the MES Proc^ram be continued in the sam^ 
two schools in which it presently operates for the next two to 
three years until sufficient data are available for an accurate 
appraisal of long term program effects. 

b. It is recommended that a decision on expansion of the MES 
Program be deferred until the results of the long term evaluation 
are available* 

c* It is recommended that program and school administrators take 
immediate steps to improve the lines of communication among 
all levels of staff* 

d. It is recommended that a formal screening procedure be established 
so that when staff vacancies occur in the MES schools ^ potential 
replacements will be made aware of the requirements involved in 
teacliing in the MES Program. 

e* It is recommended that the possibility of establishing some sort 
of transfer^without -prejudice policy limited to the MES schools 
be explored with tlie Cleveland Teachers Union* Such a policy is 
recommended because it is evident from the comments of observers, 
teachers and administrators that there are those who may be fine 
teachers in the traditional sense but who do not function well 
in a flexible and open teaching situation requiring teamtvork in 
instruction* 

f • It is recommended that training, in alternative teaching techniques 
in specific subject areas be placed high on the list of priorities 
for in-service training. 
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PROJECT DESCRIPTION 

The MES Program is aimed at creating optimal conditions 
for both learning and teaching in an effort to raise the poor achieve- 
ment patterns of inner-city school children. Through the alteration 
or organizational and instructional patterns across grades it seeks 
to increase the individualization of instruction. The program contains 
the following elements: 

• Reduced class size 

. Expanded instructional and supportive staff 

• Expanded supplemental services 

• In-service development of teachers 

• Expanded instructional materials and equipment 
. Team planning and teaching 

• Increased parental involvement in school 

A. Participant Characteristics 

The HES Program opemted in A, A, Bencsch and Wooldridge 
elementary schools, serving all students in grades K - 6, No 
non>public school students were served. Table 2 shows the 
number of pupils served by grade level. Of the total of 766 
children, an average of 60% were from families on public assistance. 

Table 2* 

Number of Children Served by ^^KS 
Program in Year 3 by Grade Level 



Grade Level Numbigr of Children 

EMR 
K 
1 
2 
3 
4 
5 
6 

Total 766 




*See Appendix A for a breakdown by school 
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Pupil turnover (mobility) averaged 68% during Year 3 (1971-72). 
At the time the program was planned, the estimated average achieve- 
ment level of the children was one year and three months below 
grade level by the end of the sixth grade. 
Project Operations 

The basic tenet of MES is that teachers will be able 
to increase the effectiveness of their teaching if they are given 
the time, the materials and the supportive staff they need and if 
the organization of the schools is altered to give priority to 
individualizing instruction. Translation of these premises into 
operations resulted in several proposed changes in the school setting. 
1. Organizational Details 

The organizational details of the program varied 
somewhat depending upon the requirements of the particular 
school, but the basic elements proposed by program planners 
were as follows: 

a. Reduced Class Size 

Program design called for reduction of class 
sizes to an average of no greater than 25 students to 
enable teachers to provide more individualized instruction. 

b. Clusters 

Classes were to* be organized into clusters of 
2, 3 or 4 classrooms each. Each cluster was to be served 
by a team composed of the homeroom teachers and teacher 
aides from the classroons in the cluster, plus one 
extra full-time teacher. The team for the cluster was to 
meet at least once weekly to cooperatively plan instructional 
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activity, each teacher sharing equal responsibility for 
the cluster as a whole. Instructional groupings within 
the cluster were to be flexible, allowing the teachers to 
regroup children from different classrooms as the need 
arose. 

c. Expanded Library Service 

The addition of a full-time librarian, library 
aide and a multi-media resource center was proposed to 
provide a variety of library equipment and materials to 
facilitate learning experiences. 

d. Expanded Instructional Equipment and Materials 

A wider variety of learning materials and equip- 
ment was proposed to permit flexibility in gearing instruc- 
tion to the individual needs and abilities of the students. 
Materials and equipment were to include the following: 

. Manipulative materials 

• Consumable materials 

• Instructional games 

• Audio-visual equipment and software 

Staffing 

Proposed changes in the organizational structure of 
the schools to permit greater individualization of instruction 
were accompanied by proposed changes in staffing patterns to 
take advantage of the reorganization, 
a. Liaison Teacher 

A Liaison Teacher was to be responsible for 
coordinating the MES Program in the two schools, and, 
working closely with the principals, effecting the 
implementation of proposed progrnn ingredients. 
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Classroom Teachers 

Additional classroom teachers were required for 
the new classes created by the reduction of class size. 
Cluster Teachers 

The organization of classes within each school 
into clusters was to involve the addition of one extra 
full-time teacher without homeroom responsibilities for 
each cluster. The cluster teacher was to be part of the 
cluster team and was to share equal responsibility with 
the homeroom teachers for planning sad carrying out 
instructional activities for the children in the cluster. 
Teacher Aides 

The program called for one teacher aide 
for every two classrooms to help free the teacher from 
clerical and other non-teaching duties in order to allow 
more time for teaching and planning. Teacher aides 
were also to provide reinforcement and tutoring for 
individuals and small groups. 
Special Subject Teachers 

The expansion of services of teachers in music, 
art and physical education was proposed to pro vide"^ students 
with a broader exposure to these areas while at the same 
time freeing classroom teachers for cluster meetings. 
Home* Curriculum Specialist 

To increase the communication between home and 
school on academic matters and to involve parents more 
directly in the education of their children, a home- 
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curriculum specialist (visiting teacher) was proposed. 
The home-curriculum specialist was to engage in designing 
instructional materials and guides for parents, work in 
the home with parents of children with specific learning 
problems, and conduct workshops for parents and community 
people on various phases of the curriculum, 

g. Community Aide 

A community aide was proposed to be responsible 
for contacting parents on routine, non-academic matters, 
so that teachers could have more time for communicating 
with parents on more substantive problems. 

h. Psychological Services 

The time allocation for a school psychologist 
was to be increased for administering tests when the need 
for such was indicated, and for malcing the necessary re- 
ferrals and recommendations » 
In-service Training 

Teachers with more time, supportive staff, small 
classes, and a greater variety of equipment and materials have 
instructional opportunities unavailable to teachers without 
these resources. Therefore an in-service training program 
was proposed to expose the MES teachers to teaching tech- 
niques that would permit them to take maximum advantage of 
the program resources. Proposed in-service offerings in- 
cluded the following: 

a, A two day pre-service meeting of all fiOS staff for 
orientation to MliS rationale, means, and objectives. 



- 27 - 



b. Training in micro-teaching techniques 
Ct Training in interaction analysis 

d. Training in the operation and use of 
instructional equipment 

e. Writing behavioral objectives 
£• Test construction 

g* Training teacliers in the effective use 
of teacher aides 

h. Training of teacher aides in rein- 
forcement and tutoring techniques 

4, Parent Involvement 

Efforts to increase communication between parents 
and teachers and to obtain greater involvement of parents in 
school activities was considered important to the success of 
the program by program planners. Consequently, efforts were 
to be made to increase the volume of teacher-initiatcd contacts 
with parents, to recruit teacher assistants from the community, 
and to solicit parent volunteers for school activities. 

5, Advisory Committee 

An MES Advisory Committee was proposed to meet 
periodically to discuss the progress of the program and to 
make recommendations regarding implementation. The Committee 
was to be composed of the liaison teacher, the two MES prin- 
cipals, two teachers from each of the project schools, and 
the program evaluator. 
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IV. F.VALUATION 

The objectives stated in the proposal were viewed as guide- 
lines for the evaluation. In some cases data were collected that were 
not related specifically to a stated objective but which in the course 
of the evaluation became available and were considered of interest. 
Further, the nature of the available methods of data analysis dictated 
occasional modification of the ways in which the objectives were 
assessed. 
A. Basic Design 

The evaluation employed either a status description or 
a cross-nested experimental -control model, depending on the nature 
of the objectives under consideration. For experimental -control 
comparisons, two Control schools (Doan and Chesterfield) were 
selected to match the MES schools as closely as possible on 
degree of poverty of pupils, attendance, mobility, achievement 
level, intelligence level, and racial composition. These Control 
schools received the services of other Title I and DPPF projects. 
Appendix B lists the characteristics on which the MES and Control 
schools were matched and shows the degree of matching attained. 

A status description model making use of project records, 
interviews with project personnel, a teacher questionnaire and 
teacher logs was used for evaluation of the process objectives, 
certain staff objectives, and some aspects of program implementa- 
tion not specifically outlined in the objectives. The cross- 
nested experimental -control design was used in evaluating the 
staff objectives related to teacher performance in the classroom 
and pupil objectives related to attendance, achievement and 
attitudes. Instrumentation included observer ratings, standardized 
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achievement tests, and locally constructed attitude scales. 
B* Presentation of Findings 

The evaluation procedures were organized around answer « 
ing four basic questions about project operation and results, and 
the findings will be organized in tlv^ same way. Each basic evalua* 
tion question will be presented, followed by an examination of the 
data collected on the objectives that are pertinent to that 
evaluation question. Included where necessary will be a description 
of instrumentation and data collection procedures* A summary of 
results will follow the presentation of all the data related to 
each evaluation question. 



EVALUATION QUESTION 1 
WERE THE BASIC INGREDIENTS OF THE PROGRAM PROVIDED AS PROPOSED? 

1. Data Collection 

In answering Question 1, each of the process objec- 
tives outlined in the proposal was considered with respect to 
the success of its implementation in practice. Data were 
obtained through school records and interviews with project 
personnel. 

2. Process Objective 1; Pre-service Orientation Program 

A pre-service program of two days duration was held 
the week before the opening day of school, attended by the 
professional staff of the two ^fES schools. Teacher aides 
were also in attendance. On the first day the program consisted 
of introductions to the Flanders Interaction Analysis tech« 
nlqucs and micro-teaching techniques using video tapes of 
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classroom teaching. The second day consisted of a panel 

report on the previous sinmner's in-service work on writing 

behavioral objectives, a display of new teaching methods > 

and planning meetings at the two project schools. 

Process Objective 1 is considered attained. 

Process Objective 2; Orderinn of Instrtictior.al F-quipmcnt 

and Material . ~ 

Purchase requisitions for all instructional equip- 
ment were submitted before the opening day of school. Partially 
because of a delay in funding, however, much of the equipment 
was not delivered until late in the year. 

Process Objective 2 was attained. 
Process Objective 3; Assignment of Supportive Personnel. 

Of the 72 staff positions to be provided or expanded 

under MES, 67 or 93^i were provided as proposed. The exceptions were: 

Benesch: 1/2 extra clerk vs. on fuU-tinc extra 

1 administrative intern vs. 1 assistant principal 

1 building substitute vs. 2 building substitutes 

Wooldridge: 1 day/week of speech therapy vs. 2 1/2 days/week 

2 days/week of visual literacy teacher vs. 1 extra 
full-time librarian 

Due to a delay in funding, two aides at Benesch and the home- 
curriculum specialist at Benesch and Wooldridge were not 
acquired until January. (See Appendix C for the complete staf- 
fing patterns) Process Objective 3 is considered achieved. 
Process Objective 4; Reduction of Class size to Average of 25. 

Examination of enrollment records showed that A. A. 
Benesch had an average class size of 21.75 students and Wool- 
dridge had an average of 22.46 students. No classroom had a 



yearly average enrollment of greater than 26 students and 
only one out of 26 had an average enrollment greater than 25. 

Process Objective 4 was attained. 
Process Objective S and 6t Cluster Organization and Veetincs. 

As proposedi groups of classrooms in each school 

were arranged into clusters, each served by a teaching team 

consisting of the homeroom teachers for each classroom and 

one extra teacher without homeroom responsibilities. A. A. 

Benesch School was organized into eight clusters as follows: 

Listening Post, EMR • 2 classes 

Kindergarten - 4 1/2-day classes 

Grade 1 -3 classes 

Grades 1 and 2 .3 classes 

Grades 2 and 3 .3 classes 

Grades 3 and 4 .3 classes 

Grades 4 and 5 .3 classes 

Grades 5 and 6 .3 classes 

Wooldridge was organized into five clusters as follows: 

♦Upper and Lower EMR - 2 classes 

*Kinderpirten and Pre- 

Kindergarten • 4 l/2-day classes 

Grades 1 and 2 • 3 classes 

Grades 3 and 4 « 2 classes 

Grades 4, S and 6 .3 classes 

*(No cluster teacher) 

As proposed, each cluster team met for 80 minutes 
per week to plan and coordinate instruction for the children 
in the cluster. Records of each meeting were kept for review 
by the principal and the liaison teacher. The data indicate 
the objectives were attained. 
Process Objective 7t In-service Training. 

In-service training was offered in three sessions: 
fall, spring and summer of 1972. In the fall session, eight 
weekly two-hour sessions on interaction analysis were conducted 
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with paid attendance by teachers. Out of a total ms teachinp 
staff of 62, 48 teachers and administrators were in attendance. 

In the spring session another eight weekly two-hour 
Meetings were held dealing with micro-teaching techniques. 
TWenty-two teachers attended. 

Twenty-four teachers attended the summer in-service 
session which was conducted 2 hours per day over the course 
of two weeks. Enrollment was limited by the election of many 
teachers to teach summer school. The summer in-service session 
focused on constructing test items for the behavioral objec- 
tives written during the previous year's in-service. 

In addition to the regularly scheduled in-service 
sessions, 30 teachers spent one day observing a similar pro- 
gram in Detroit to compare the two operations and exchange 
ideas. Also, five representatives from the two ms schools 
attended a one-day workshop in Columbus on the individualiza- 
tion of reading instruction. After their return they held a 
demonstration workshop to disseminate the information to the 
rest of the MES teaching staff. Finally, 2 two-hour sessions 
attended by all MES teaching staff were held to disseminate 
the results of the evaluation of the previous year's program 
operations. 

In-service sessions were also organized and scheduled 
for teacher aides. Ti/olve course meetings of one hour each 
were held throughout the year with mandatory attendance by 
teacher aides. Topics covered in the meetings included 
tutoring techniques in reading and math, uses of manipulative 
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devices, small Rroup reinforcement, speech habits, use of 
equipment, and becoming an active participant in the cluster. 

An in-service program addressed to five of the seven 
areas outlined in the program plans was conducted as proposed. 
Process Objective 7 was attained. 

MES teachers were asked, on a questionnaire, to list 
the areas of in-service training they felt were most needed 
during the coming school year. Fifty-two out of the 61 staff 
members .returning the questionnaire responded to the question, 
and their most frequent suggestions are summarized in Table 3. 

Table 3 

Teacher Recommendations for Future In-service Training 



rercentage MaKing 
Recommended Traininn Arc«i ' Recommendation 

Training in alternative techniques for 

creative, individualized instruction within 

specific subject areas - mostly language 

arts and math 33% 

Preparing tests and lessons to correspond 

to behavioral objectives 21% 

Operation of equipment and effective use 

of media in instruction %$% 

Exchange of innovative teaching ideas 

through visiting or meeting with other 

clusters or other school systems 12% 

Constructing teaching aids and materials io% 

(A variety of suggestions other than those listed were suggest* 
ed> but in each case these were suggested by fewer than 6% of 
the teachers.) By far the most frequently listed suggestion 
for in-service was training in teaching techniques for specific 

i 

subject areas. This is the same area that was suggested with 
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the greatest frequency in Year 2. The second mst frequently 
suggested in-service area was preparing tests and lessons to 
correspond to behavioral object ives^ which appears to be a 
natural follow-up .o the work done during Year 2 on writing 
th^ objectives. Training in the operation and use of nedia^ 
the third wost frequent suggestion^ has been suggested with 
some frequency by teachers in every year of the fES program, 
but to date there has been no organized in-service program 
addressing this need* A new concern of the teachers with 
communication of ideas appeared in Year 3, idea exchange 
being the fourth most frequently suggested area for in-service. 
This represents an increase over Year 2 when idea exchange was 
placed well down on the list of suggestions. Finally, work on 
constructing teaching aids was the fifth mo3t frequently sug- 
gested in-service area. In Year 2 it was the most frequently 
suggested area, and its drop on the list of teachers' prior- 
ities is probably related to the work done in this area during 
the summer of Year 2. 

Summary of Question It Were the Basic Ingredients of the 

Program Provided as Proposed ? 

The results of the evaluation of the process objec- 
tives indicate that all seven objectives were achieved* 

a. A pre-service orientation session was held as proposed, 
except that it was held for two rather than three days. 

b. Equipment and materials wore ordered as proposed. 

c. With two exceptions all personnel were assigned as 
proposed. 
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d. Class size was reduced to an average of not over 
25 as proposed. 

e. The classrooms in MRS schools were organized into 
clusters as proposed. 

f# The team of teachers serving each cluster met weekly 
for joint planning as proposed* 

g# An in-service course for teachers was conducted as 
proposed, althouf^h previously identified needs were 
not completely addressed. 



EVALUATION QUHSTION 2 

HOW SUCCESSFUL WERE TIIE SCHOOL STAFF IN MAKING USE OF THE 
INGREDIENTS OF THE PROGRAM? {WERE THE STAFF OBJECTIVES ATTAINED?) 



1. Data Collection 

In evaluating the degree to which the staff objectives 
were attained, comparisons bet;;een h!ES and Control schools on 
teacher performance were made by sending a team of six ob- 
servers into the schools to observe classes in March, April 
and May, 1972, The observers assessed the quality of instruc- 
tion by rating various aspects of teaching performance on a 
locally constructed rating scale, a copy of which appears in 
Appendix D. The observation team consisted of the following 
individuals: 

. Principal of Milliken School, Cleveland Heights 
. Professor of Education, John Carroll University 
. Principal of Malvern School, Shaker Heights 
. Assistant Principal, Beechwood Middle SchOi^U 
Beechwood 

. Home-School Liaison Teacher, Prospect School, 

East Cleveland 
. Home-School Liaison Teacher, Mayfair School, 

East Cleveland 

Prior to their observations, the team was briefed 

on the rationale, purpose and organization of the JJES program. 
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Each observer spent three days observing in each MES school 
and one day in each Control school for a total of eight 
observation days per observer^ (The distribution of time 
among the schools was made upon the recommendations of 
observers during the previous year's evaluation.) 

Table 4 shows the number of teachers observed at 
each MES and Control school and the number of observations 
made* 

Table 4 



Number of Teachers Observed and Observations 





Made in MI:S 


and Control Schools 


School 


Observations 


Teachers Observed 


A. A. Bcnesch 




93 


30 


Wooldridge 




75 


17 




TotPl MES 


168 


Total MI-S 47 


Doan 




35 


16 


Chesterfield 




35 


19 




Total Control 


70 


Total Control 35 



The classrooms observed were not pre-selected; 



rather the observers were allowed to roam the building at will, 
dropping in on any class they chose. Teachers were not fore- 
warned as to when observers were scheduled to visit. The 
only direction observers were given as to selection of class- 
rooms was to try to spread their observations evenly over the 
grades and to try to attend cluster meetings. 

Table 5 shows the average number of observations 
made per classroom in MES and Control schools at each grade 
level. 
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Table 5 



Average Number of Observations Per Classroom in HES 
and Control Schools by Grade 




2. Staff Objective 1; MES Superiority In the Use of Media , 

The team of observers was asked to rate both the 
extent and the effectiveness of the use of teaching aids in 
the classrooms they observed. They found a significant dif- 
ference in favor of the teachers in MES schools in both the 
extent of use of teaching aids (_z = 3.73, £<.0007)J and the 
effectiveness of the use of teaching aids f z = 2.08, £<.02). 

In interviews and written reports following the 
completion of the observation schedule most observers commented 
that the availability and use of equipment in the MES schools 
was generally impressive and appeared to allow for alternate 
approaches to learning. Staff Objective 1 was achieved. 



To make statistical comparisons of the observers' ratings of 

MES and Control schools, a mean rating was computed for each classroom 

observed on each iten of the rating scale. Pifforcncos were then tested 
with the Mann-Whitney U Test. 
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Staff Objective 2; MHS Superiority in Orr^anization and 

Preparation of Lessons, 

The observers were asked to rate the amount of 
organization and planning evident ^in the lessons they observed. 
Analysis of the observations revcaXed a significant difference 
in favor of teachers in MES schools\n the planning and organiza. 
tion of class activity. (£ = 1,95, jp^<;03) 

Staff Objective 2 was achieVed. 

Staff Objective 3: MES Superiority in Degree of Individual 

Attention to Students. 

The question put to the observers was: Mow would 
you rate the degree of individual attention given the students 
by the teacher? The ratings submitted showed a highly signif- 
icant difference in favor of the MES schools (£ = 3.77, 
£<.0007). 

Staff Objective 3 was attained. 

Staff Objective 4: MES Teachers Spend Less Time on Non^teach- 

ing Duties. 

On a questionnaire the MES teachers were given a list 
of duties and asked to estimate the proportion of their typical 
work week that they spent performing each, both before and 
after the advent of the ^fES program. Thirty-two out of 60 
teachers responded appropriately to this question, and their 
averaged responses appear in Table 6. 
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Table 6 



Average Proportion of Time Spent by ^fES 
Teachers in Various Activities 



Activity 



Before 

MES 



Teaching 
Planning 

Parent conferences 

Extra-curricular activities 

Non^teaching supervision of 
children (e.g. hall duty, 
breakfast, etc.) 

Non*teaching clerical work 




Mean % of Time 



Now 



65%^ 69, 9O 

11,5% ^ SKl'i 16,4^w > 91,8^ 
4,6%^ 5,5% 



18,8% 




8,2% 



The data show that^ according to the teachers the 
percentage of time they spent in activities related to teach- 
ing, (teaching, planning and parent conferences) increased 
with the MES Program, while the percentage of time spent ir 
activities not related to teaching (extra-curricular activities 
supervisory duties, and clerical work) decreased. The pattern 
becomes clear when the percentages of time spent in activities 
related to teaching are combined and compared with the time 
spent in the non-teaching-related activities combined. The 
decrease in the amount of time spent in non-teaching related 
duties was statistically significant (t^ = 5,66, df s 30, 
p<.0005, 1-tailed test). Staff Objective 4 was achieved. 
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Staff Ohjcctive S; MES v^upcriority in the Incidence of 

Parent Contacts, 

a. Data Collection 

Two types of data were collected rehnive to 
this objective: 

• Frequency of parent contacts 

• Reasons for parent contacts 

The means required to obtain these data precluded compar- 
isons between MES and Control schools, Each NIES homeroom 
teacher was required to keep a log of her contacts with 
the parents of the children in her class. The logs in- 
eluded the reason for each contact. Records were also to 
be kept by the home-curriculum specialists and the com- 
munity aides serving each school. The role of the community 
aides was to make routine contacts with parents on atten- 
dance matters and personal problems, such as illness and 
clothing needs, to free the teachers to make contacts on 
more substantive matters. The role of the home-curriculum 
specialist was to increase the parents' involvement in 
their childrens* school work through working in the home 
with parents of children with specific learning problems, 
conducting workshops for parents and community people on 
various phases of the' curriculum and designing instruction- 
al materials and guides for parents use at home with their 
children, 
b. Frequency of Parent Contacts 

Table 7 presents the percentage of children at 
each school whose parents were contacted at least once by 
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teachers during the school year and the average number 
of contacts made per classroom. Data are presented for 
Year 1, Year 2 and Year 3 of program operation. 
Table 7 



Teacher-Parent Contacts at ^ES Schools 
During Year 1, Year 2 and Year 3 



School 


Mean Percentage of 
Parents Contacted 


Average Number of 
Contacts per Classroom 




Year 
J 


Year 
__2 


Year 
3 


Year 
_1 


Year 
2 


Year 
_3 


A. A. Benesch 


84% 


86% 


91% 


50.3 


46.1 


61.0 


Wooldridge 


47% 


61% 


92% 


11.5 


37.1 


73.0 


Total 


6S% 


77% 


92% 


30.9 


-44.9 


62.3 



The data show that during Year 3 the Benesch 
teachers maintained the same high level of parent contacts 
as tbey did during Years 1 and 2 and increased the over- 
all frequency of contents, Wooldridge teachers made 
further progress in improving their contacts with parents 
during Year 3, increasing both the percentage of parents 
contacted and the number of contacts per classroom. 

Table 8 presents a breakdown of the parent 
contact data according to the number of times each parent 
was contacted. Data are again presented for Year 1, Year 
2 and Year 3, 
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Table 8 

Percentage of Parents Contacted with Varying Frequencies 
at MES Schools During Year 1 and Year 2 



School 


Pcrccntacje of Parents 


Contacted 
Once 


Contacted 
Twice 


Contacted 3 or 
nore times 




Year Year Year 
1 2 3 


Year Year Year 
12 3 


Year Year Year 
1 2 3 


A. A. Bencsch 


30% 33% 30% 


29% 33% 28% 


41% 34% 42% 


Wooldridpc 


63% 38% 17% 


26% 23% 22% 


11% 39% 61% 


Total 


479- 37% 26% 


29% 27% 


3S% 46?^ 



The data show that in Year 3 in Bencsch the 
majority of the parents contacted (76%) were contacted 
two or more times. In Wooldridge, the majority of the 
parents (61%) were contacted three or more times in Year 
3, a further improvement over Year 2, 



The community aide at Benesch made a total of 
116 parent contacts during Year 3, a substantial decrease 
from the 540 contacts in Year 2. At Wooldridge there were 
no data available on community aide activities. At 
Benesch the home-curriculum specialist made a total of 
199 parent contacts while at Wooldridge the total was 179. 
c. Reasons for Parent Contacts 

There were a variety of reasons the teachers, 
home-curriculum specialists and community aides communi. 
cated with parents in Year 3. Table 9 summarizes the 
percentage of contacts that were made for different 
reasons by teachers, home-curriculum specialists and 
conmiunity aides. Community aide data are available for 
Benesch only. 
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Table 9 



Percentage of Parent Contacts According 
to Reason for Contact 



Reason 
.for 
Contact 


Contacts 

by 
Teachers 


Contacts by 
Home-Curriculum 
Specialists 


Contacts by 
Community 
Aides 




Total 


Benesch Woold. 


Total 


Benesch Woold. 


Hcnesch 


Parent involvement 
in meetings, pro- 
grams, etc. 


39% 


36% 


43% 


19% 


39% 0% 


25% 


Academic matters 


37% 


44% 


22% 


29% 


15% 42% 


6% 


Discipline or 
conduct 


11% 


9% 


13% 


9% 


3% 16% 


1% 


Personal adjustment 
problems or non- 
academic natters 
such as illness or 
clothing needs 


9% 


7% 


12% 


18% 


25% » 11% 


37% 


Attendance and 
enrollment matters 


6% 


3% 


10% 


25% 


18% 31% 


31% 



The table shows that the parent contact activi- 
ties of the teachers and the community aide (at least at 



Benesch) were complementary as intended. The majority of 
contacts by the community aide were related to attendance 
and non^academic personal problems, while the majority 
of the contacts by the teachers in both schools were re- 
lated to academic and parent involvement matters. That is, 
many of the routine contacts were handled by the community 
aide, freeing the teacher to make contacts on more sub- 
stantive matters. (It would appear that teachers were re- 
lieved of routine contacts to a somewhat greater extent at 
Benesch where only 19% of the teacher contacts were related 
to routine non-academic matters as opposed to at Wooldridge.) 
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The distribution of contacts made by the home- curriculum 
specialists, however, did not reflect the intent of the 
program plans in creating that position. Almost all of 
the contacts made by the home-curriculum specialists should 
have been related to academic matters and parent involvement, 
but in both schools, about half of the contacts were re- 
lated to routine matters that should have been the pro- 
vince of the community aide. 

In summary, the success of the teaching staff of 
both MES schools in their efforts to establish contact 
with the parents of the children in their classes leads to 
the conclusion that Objective 5 was achieved. However, 
the data showing that large percentages of the parent con- 
tacts made by the home-curriculum specialists were not 
related to their defined area of responsibility suggest 
a review of the use being made of these specialists. 

With respect to the community aides, the data 
from Benesch showing a total of only 116 parent contacts 
and the lack of any data at all from Wooldridge raises 
questions concerning the need for full-time personnel at 
these positions. It is entirely possible of course, that 
the need for full-time community aides would be apparent 
if the distinction between the responsibilities of the 
aides and the responsibilities of the home-curriculum 
specialists were more clearly drawn« 
7. Other Areas of Teacher Performance 

In addition to gathering data related to the five 
Staff Objectives, the team of observers was asked to compare 
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MES and Control schools on other aspects of teachers • class- 
room performance. The areas of classroom performance rated 
and the results of the comparison between MES and Control 
classrooms are presented in Table 10. 
Table 10 

Results pf Ratings of MES and Ccrtrol Schools 
on Various Areas of Teacher Performance 



Dimension of Classroom Performance Rated 



Findinp 



1. Creativity in instruction 



2. Variety of materials and methods 
used 



3« Adaptation of response and 

materials to number of students 



Use of childrens* background 
and experience in lesson 



Effort to encourage independence 
of thought 



6, Opportunity for childrens* 
active participation 



?• Interaction among students 
encouraged 



8. Teacher's receptivity to 
spontaneous questions 

9. Quality of teachers* verbal 
communication with children 



10, General quality of teaching 



lit Amount of material covered 



12. Object of the lesson defined 
to children 



Statistically significant 
difference in favor of MES 
(£« 1.P3, £<.03) 

Statistically significant 
difference in favor of MES 
iz « 1.89, ]><.03) 

Difference in favor of MES, 
approaching statistical 
significance (£ « 1.S3, £<.07) 

Statistically significant 
difference in favor of MES 
iz « 2.49, £<.007) 

Difference in favor of MES, 
approaching statistical 
significance (z* 1.39, £<.085) 

Statistically significant 
difference in favor of MES 
iz « 2.12, £ < .02) 

Statistically significant 
difference in favor of MES 
(z « 3. 35, £<.0007) 

No difference between ^^ES and 
Control 

Statistically significant 
difference in favor of MES 
(z « 2.22, £<.02) 

No difference between MES and 
Control 

No difference between MES and 
Control 

No difference between MES and 
Control 
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Tabic 10 shows that in Year 3 teachers in }ms schools 
scored significantly higher than teachers in Control schools 
on 8 out of 12 rating items measuring various aspects of 
teacher performance in the classroom. This represents an 
iJiT'rovcment over Year 2 in which MES teachers were rated superior 
on 5 out of 10 rating items. In addition, the observers 
reported that in 58'* of the lessons observed in MES schools a 
larger class size would have seriously impeded or cojnpletcly 
destroyed the effectiveness of the lesson. This finding is a 
notable improvement over the previous year in which observers 
reported that a larger class size would have made little dif- 
ferenc^L.in over two-thirds of the lessons. 

In examining the results in Table 10 it would seem 
somewhat inconsistent that the MRS teachers were rated as 
superior on such dimensions as creativity of instruction, 
variety of materials and methods, effort:; to encourage in- 
dependence of thought, etc., and yet were rated as not superior 
on overall quality of instruction. In questioning the observers 
following their series of visits to the schools and in reading 
their written reports, it became clear that they tended to 
draw a distinction between superior teachers and teachers with 
superior resources . That is, they concluded that the MES 
teachers engaged in teaching activities made possible by the 
organizational, staffing and hardware elements of the program, 
but that they were not inherently better teachers than the 
Control teachers. Thus, small classes, supportive staff and 
an abundance of materials and equipment enabled MES teachers 
to be raore creative, to use a wider variety of approaches. 
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etc*, but Control teachers were judjjcd equal in overall 
quality of instruction nivon the resources available * As 
one observer put it, "All seemed to be trying to provide for 
individual differences, but the MES teachers have a better 
chance to do this successfully." At any rate, the assumption 
underlying the MES program is not that it will transform 
average teachers into good teachers but that it will give 
teachers in general the resources to do better what they are 
already trying to do. The distinction may be slight in terms 
of the end result, and the observers' ratings seem to indicate 
that the program is having its desired effect on teaching 
activity. 

8# Student Response to Teacher Performance 

The observers were asked to rate the response of 
the students to the lesson being observed. Their findings 
are presented in Table 11. 

Table 11 



Results of Ratings of MES and Control Schools 
on Student Response to Lesson Being Observed 



Dimension of Student 
Behavior Rated 


Finding 


Interest and enthusiasm 


No difference between 
ME3 and Control 


Active participation in 
lesson 


Statistically significant 
difference in favor of MES 
(£ « 2.49, £<.007) 


Proportion volunteering 
answers to teacher 
questions 


No difference between 
MES and Control 


Proportion raising 
spontaneous questions 


Statistically significant 
difference in favor of MES 
(£ « K77, p <.02) 
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Althounh there was no difference between MES and 
Control schools in the interest and enthusiasm the teachers 
generated in the students, or in the proportion of students 
volunteering answers to teacher questions, the MF.S schools 
di'l receive higher ratings in terms of student participation 
in the lesson and the proportion of students raising svontane« 
ous questions* This finding reinforces the observers' ratings 
of teacher performance indicating that the MES schools were 
characterized by a greater opportunity for student participa* 
tion and greater encouragement of independence of thought h/ 
students* 

Operation of the Cluster 

The organization of the MKS school?, into several 
clusters of three or four classes, each served by a team of 
teachers, was documented in the evaluation of the process 
objectives* The observers were asked several questions 
specifically designed to examine the effects of the cluster 
on classroom organization* 
a. Grouping of Students for Instruction 

One function of the cluster w.iS to allow 
flexible grouping of children within and among the 
classrooms in the cluster as the need arose* To de- 
termine the extent to which children were grouped aniong 
the classrooms, each time a classroom was observed the 
observers were asked to describe the student population 
present by checking one of several des% viptions offered 
on the rating form. The findings in the MES and Control 
schools are presented in Table 12. 



Tabic 12 



Percentage of Lessons Observed in Relation to 
Distribution of Students Anonp Classrooms 



Description of Classroori 


Percentage of Lessons 


MES 


Control 


Class intact 


53% 


88% 


Some children out with 






another teacher 


28% 


12% 


Some children in from 






another class 


18% 


0% 



The data in Table 12 show that there was considerably 
more^ interchange of students among classrooms in the 
MES schools than in the Control schools. In 47% of 
the cases observed some of the children in the MES 
classroom under observation were either out of the room 
with another teacher or were in from another classroom^ 
In contrast, classrooms in Control schools were never 
observed to have children from another classroom^ 

To determine whether Ml:S teachers were using 
the resources of the cluster for grouping children 
within the classroom, the observers were ashed to make 
the following three observations on each classroom 
observed. 

(1) Was there more than one activity going on in 
the classroom at the same time? 

(2) Was ability grouping employed? 

(3) Were learning stations evident in the classroom? 

The results of the observations in both MES 
and Control schools are presented in Table 13. The table 
shows that on all three indicrs the ftES schools were 
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observed to have a higher frequency of grouping children 
within the classroon than the Control schools. 
Table 13 

Frequency of Three Indices of Groupinp, Within 
MES and Control Classrooms 



Observation 


Percentage of Classroops 


MliS 


Control 


Multiple Activity 


71% 


47% 


Ability grouping 


72% 


51% 


Learning stations 


84% 


53% 



b. Use of Extra Staff 

To determine the extent to which staff in the 
clusters tended to work tofrether, the observers were asked 
to note the number and type of teaching staff in MES class« 
rooms. These data together with similar data from Years 1 
and 2 are presented in Table 14. 
Table 14 

Number and Type of Staff Observed in Classroom 



Staff Present 



Homeroom teacher alcne 
Cluster teacher alone 
Special staff alone 
One professional and 
aide 

Two or more profes- 
sionals with or with- 
out aide 



Percent of Lessons Observed 



Year 1 



55% 
9% 
9% 

12% 



16% 



Year 2 



39% 
1% 
0% 



23% 
37% 



Year 3 



35% 
2% 
7%. 

27% 
29% 



The data show that in Year 1 teachers were found workinj* 
alone in almost 3/4 of the cases observed (73%). In 
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Year 2 and Year 3, however, the number of cases of 
teachers working alone decreased markedly to about four 
out of 10. Some of the decrease in Years 2 and 3 might 
be due to increased numbers of cluster teachers and 
teacher aides, but it is clear that there was a greater 
tendency for the staff to work together. 

To determine how well the extra staff were used, 
the observers were asked to compare MES and Control schools 
on the effectiveness of the orpanization and use of extra 
personnel in the classroom. Their findings are presented 
in Table 15. 

Table 15 



Observers' Ratings of Effectiveness of Organization 
and Use of Extra Personnel in the Classroom 



Rating 


Percentage of 
Lessons Rated 




MHS 


Control 


Very effective distribution 
of tasks among staff in 
classroom 


50% 




27% 


Moderately effective distribu- 
tion of tasks among staff 


38% 




42% 


Poor distribution of tasks 


12% 




31% 



The table shows that almost twice as many MES lessons 
as Control lessons observed were rated as having a 
very effective distribution of tasks among the staff, 
and that well over twice as many Control lessons were 
rated as having a very poor distribution of tasks. The 
difference in mean ratings between MES and Control class- 
rooms is statistically significant as determined by the 
Mann-Whitney U test (£ « 1,97, £<.03). 



c. Use of Cluster Planning; Meetings 

Asked to comment generally about the effective- 
ness of the cluster meetings observed, most observers 
agreed that the cluster meetings afforded the cluster team 
a real opportunity for give and take of ideas and joint 
planning of instruction. Most meetings were judged as 
professional, productive and of real value to the teachers 
involved. There were exceptions, of course; in some meet- 
ings deep conflicts between teachers were apparent, and 
some were characterized as very unproductive with teachers 
seeming to merely go through the motions of joint planning. 
As in previous years, the observers expressed the feeling 
that in several cases the cluster was not being used to 
its full potential. In general, however, the cluster meet- 
ings made a positive impression. 

Several suggestions emerged from the observations 
of the cluster meetings: 

(1) Cluster teams should strive for greater 
integration of subject areas. 

(2) One long meeting per week appeared more 
productive than two shorter meetings 
because the time available in the longer 
meeting allowed more depth of discussion. 

(3) There could be greater participation 
(not attendance) of aides in cluster 
meetings. 

When given the opportunity to subjectively rate 
the operations of individual clusters on a five-point scale of 
from excellent to very poor, four of the eight clusters in 
Benesch, and two of the three clusters in Wooldridge were 
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judged on the average "good". This represents im- 
provement over the previous year in which only three 
clusters were singled out as having well-organized, 
smoothly functioning teaching and planning teams. 
Use of Teacher Aides 

It has already been noted that the observers rated 
the MES schools superior to Control schools in terms of the 
organization and use of extra personnel in the classroom. 
When asked to comment specifically on the use of teacher aides, 
the observers reported that in most cases they appeared to be 
used in a productive manner in a variety of tasks ranging from 
clerical work to small group reinforcement. It was suggested, 
however, that training be offered to teachers in making the 
best use of these paraprofessionals, and that in-service also b 
provided the aides themselves. The latter suggestion, of 
course, had already been implemented. 
Teacher Opinion of Program Operation 
a. Data Collection 

In order to obtain feedback f'^^om the ^!ES staff 
on certain aspects of program operation, a locally con- 
structed questionnaire was distributed to the teaching 
staff of 62 persons. Questionnaires were returned by 61 
staff members or 98%. The questionnaire consisted of a 
series of statements about the MES prograia to which the 
teachers were asked to respond by indicating the degree 
to which they agreed or disagreed with the statement on 
a five point rating scale. The scale allowed two levels 
of agreeir.ent (Agree and Strongly Agree), two levels 
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of disagreement, and a neutral response indicating no 
opinion. In addition, the questionnaire contained several 
open-ended questions related to various aspects^^of program 
operation • 

The questionnaire allowed gradations of response 
from Strongly Disagree to Strongly Agree, but these were 
primarily for the teachers • benefit. For purposes of 
evaluation, interest ^ .uters primarily on whether the 
teachers basically agreed or disagreed with a statement 
irrespective of the degree of agreement or disagreement. 
For this reason, in analyzing and interpreting the data, 
the various levels of agreement and disagreement were 
combined. A problem arose, hov/ever, with respect to the 
neutral response, especially when large numbers of teachers 
choose it. For purposes of simplifying data presentation, 
the percentage of teachers choosing the neutral response 
was split between the agreement and disagreement sides 
of the response scale. A copy of the questionnaire with a 
summary of responses appears in Appendix E, 
Teacher Stat isf act ion with Program Resources and Operation 

The results of the teacher questionnaire in- 
dicate that basic satisfaction (75% or more of the teachers) 
bxisted with respect to most elements of program operation, 
including the following: 



*• Definition of program purpose 
and goals 

• Definition of program structure 

and orpanization 
. Definition of teaching methodology 
. Definition of roles 
. Effectiveness of class size of 25 
. Provision of instructional equipment 
. Variety of instructional materials 

• Performance of teacher aides 

♦ . Freedom to innovate in teaching 

• Concept and value of the cluster 

approach 

• Use and effectiveness of the 

cluster approach 
. Cooperation among teachers within 
the cluster 
*• Coordination between clusters and 
special subject teachers 
. Increased contact between school 
and community 

• Impartiality of the MES evaluation 

report 

This listing represents some improvement over 
the previous year when several of the elements listed here 
were identified by teachers as problem areas. These in- 
stances arc identified in the listing by asterisks. 

The teachers were asked in an open-ended question 
to indicate what they felt were the most valuable elements 
of the MES Program. A sammary of their responses appears 
in Table 16. The table shows that by far the most 

Table 16 



Teachers • Perceptions of the Most Valuable 
Elements of the MES Program 





Percentage of 


Program Element 


Teachers Responding * 


Small Classes 


48% 


Cluster approach 


47% 


Individualization of instruction 


42% 


Equipment and materials 


24% 


* Opportunity for professional growth 


20% 



* Percentages add to more than lOOu because r?.tiny teachers listed 
niore than one program element. 



- 56 • 



frequently cited aspects of the program were the small 

classes, the cluster approach to teaching and planning, 

and the individualization of instruction made possible by 

the profiram's resources. These are the same items that 

were cited most frequently by teachers in Year 2. Other 

aspects of the program than those shown in Table 16 were 

listed by some teachers, but by less than 10% in each case. 

Teacher Dissatisfaction with Program Resources and Operation 

There are also elemeats of program operation with 

which significant proportions of teachers indicated some 

degree of dissatisfaction or a need for improvement. 

In no case in which dissatisfaction was indicated 

was it expressed by a majority of the teachers. However, 

such indications by one third of the teachers or more 

were considered serious enough to warrant mention. 

Aspects of program operation with which teachers 

appeared less than satisfied included the following: 

. Training of teacher aides 
. Accessibility of supplies 

• Provision of planning time 
In-service training 

. Teacher involvement in decision making 

• Communication a™ng teachers, 
administrators and liaison personnel 

Although over 80% of the teachers agreed that 

considering their training, teacher aides did an effective 

job, some 60% indicated that the teacher aides needed more 

training. 

Although 89% of the teachers agreed that there was 
a wide enough variety of instructional materials provided, 
over one-third indicated that they were not always 
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accessible when needed* 

Sone inconsistency emerges with respect to the 
teachers* evaluation of the amount of planning tine they 
are provided. Seventy-five percent of the teachers agreed 
with statements asserting th.*t adequate tine was provided 
for planning and record keeping. When asked ^ however, to 
report their number of free periods per week and whether 
they considered that number adequate, 91% reported five 
or more per week, but 35% characterized their number as 
inadequate. 

When responding to statements regarding in* 
service training, sizable proportions of the teachers 
chose to maintain a neutral stance. (See Appendix P ). 
This may reflect the numbers of teachers that did not 
participate in the in-service courses. When the pro- 
portion of teachers giving a neutral response is split 
between those taking a definite positive or negative 
stance, over one third of the teachers considered the in- 
service training less than adequate, less than effectively 
conducted and not of benefit to them personally. The 
validity of the latter two responses is questionable in 
as much as more teachers responded to the question than 
actually participated in the in-service training. On 
the question of whether in-se:-vice training should be re- 
quired of MES teachers, however, fewer teachers (15%) 
took a neutral response resulting in 65% pgreenent that 
in-service should be required. 
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The areas of greatest dissatisfaction awonR the 
teachers were related to teacher involvement in decision 
waking and the adequacy of communications among all levels 
of the MES staff and administration. In response to all 
statements asserting that teacher involvement in decision 
making and communication channels among the staff were 
adequate, over one-third and sometimes almost half of the 
teachers disagreed. 

The foregoing description of teacher dissatis-* 
faction with the MI;S Program is based on teachers' re- 
sponses to questionnaire statements regarding specific 
aspects of program operation. Teachers were also given 
the opportunity on an open-ended question to list what 
they considered the major problems facing the program. 
The most frequent responses are summarized in Table 17. 
Table 17 

Teacher Perceptions of Major Problems 
Facing the MES Program 

Percentage of Teachers 

Problem Responding* 

Communication and cooperation 

among teachers, administrators 

and liaison personnel 36% 

Selection of staff who are 

willing to put forth the 

effort needed for program 

success 36?i 

Administrative and liaison 

leadership 15% 

Role definition 12% 

Student discipline 10% 
• 

* Percertaftcs acid to more than lu()% because many teachers 
listed more than one problem 
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The table shows that teachers perceived the greatest 
problems with the MES ProRram to be related to coiamunica* 
tion and cooperation anonR the staff and to selecting* a 
staff fully coimnitted to the success of the propran. 
The first findinj; reinforces the conclusion drawn from the 
analysis of areas of teacher dissatisfaction with proj»ram 
operation. The second finding illustrates an important 
concern of the teaching staff that was not addressed by 
specific questions on the questionnaire. Typical of 
teacher comments related to dissatisfaction with staff 
selection are the followinc: "Teachers are too tradition- 
ally bound - unwilling to chanpe. . .Not enounh teachers 
seem willing to go the extra 10% to make this program 
different". The third and fourth most frequently men- 
tioned area of concern of the teachers was the leadership 
provided by administrative and liaison personnel and role t 
inition. 

The four areas of concern discussed above are 
basically the same problem areas identified by teachers in 
the previous year of operation of the program. It is pos- 
sible that in any program requiring cooperation and team- 
work there will be conflicts and disagreements among the 
staff, but judging by tlie statements of tlie MES teachers 
themselves, it appears that the degree of staff conflict 
in the MES Program should be of serious concern to the 
program administrators. Over two-thirds of the teachers 
cited cooperation, communication or uncommitted staff as 
serious problems. 
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d. Overall Attitude Toward MHS Pronran 

Teachers were asked to indicate how they general- 
ly felt about the MliS Program as it now stands. Ninety-one 
percent indicated positive feelings of one degree or 
another, but only 29% indicated that they felt completely 
positive. Further, when asked their opinion of contin- 
uation or expansion of the program, only 18% voted for 
continuation or expansion of the program as it now stands , 
while 79% favored continuation or expansion with modifica- 
tions. In general, the prevailing opinion of the ms 
teachers seems to be that the program is a good one but 
that ther** are serious problems that must be dealt with 
if it is to meet with success. 

Summary of Question 2; How Successful Were the School Staff 
in Making Use of the Innrcdients of the Pro^yratn? ' 

a. Staff Objectives 

The data collected relative to Evaluation Question 
2 show that all five staff objectives stated in the pro- 
posal were achieved: 

(1) Classroom observers found a statistically significant 
difference in favor of the teachers in MKS schools in 
the extent and effectiveness of the use of teaching 
aids. 

(2) Classroom observers found a statistically significant 
difference in favor of teachers in MES schools in the 
organization and preparation of lessons. 

(3) Classroom observers found a statistically significant 
difference in favor of teachers in flliS schools in the 
degree of individual attention given to students. 
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(4) Responses to a teacher questionnaire indicate that 
MliS teachers spent significantly less tine in the 
perfomarice of non<-teachint! related duties than they 
did before the proj^ram bet^an. 

(5) Teacher lo\:s revealed a successful effort on t!ie 
part of MI-S teachers to increase their contacts 
with parents. Houever, a review of the duties of 
the howe^curriculun specialist and the community 
aide is needed. 

b. Other Areas of Tcaciier Pcrfomance 

With respect to other areas of teacher per* 
formance, the classroom observers found that: 

(1) MHS teachers were rated sijjnificantly higher than 
Control teaciiers on 8 out of 12 measures of teacher 
performance in the classroom. 

(2) MES teachers were judged as not inherently superior 
to Control teaciiers in overall quality of teaching! 
but were judged to be able to do a more effective 
job because of the resources provided by the propran, 

c. Student Response to Teacher Performance 

In rating the response of the students to the 
teachers* classroom pcrfomance the observers ratings 
showed that: 

(1) There was no difference between f^KS and Control 
schools in the interest and enthusi<nsm of the 
students or in the proportion of studentn volunteer- 
ing answers to teacher questions. 

(2) MES schools were rated significantly higher in terms 
of student participation in lessons and in the 
proportion of students raising spontaneous questions. 

d. Operation of the Cluster 

Kith respect to the operation of the cluster, 

the observers reports and ratings showed the following: 

(1) There was a substantially greater frequency of 
interchange of students among classrooms in MES 
schools than in Contrfti schools. 
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(2) There was a substantially greater deRrcc of proupin,^ 
children for instruction within classrooms in MliS 
schools than in Control schools* 

(3) The tendency for MHS staff to work tORCther in the 
classroom remained improved over the first year of 
program operation, 

(4) The orjianization and use of extra staff in the 
classroom was rated as effective in a substantial! ' 
greater protwtion of MHS classrooms than Control 
classrooms, 

(5) V/ith some exceptions the cluster meetinns in MEs 
schools were judned as productive and valuable ro 
the teachers, 

(6) Six out of the 11 clusters in the MES schools 
were subjectively rated as "jjood'' in tlieir overall 
operation. 

Use of Teacher Aides 

(1) The use of teacher aides was judged as productive 
in most MHS classrooms, 

(2) In-service training', was supRested for teachers in 
the effective use of paraprofessionals. 

Teacher Opinion of Program Operation 

Analysis of MliS teachers* responses to a question** 
naire on various aspects of program operation indicated 
the following: 

(1) The teachers were satisfied with most elements of 
program operation, 

(2) Teachers perceived the most valuable aspects of 
the program to be small classes^ the cluster ap- 
proach, and individualization of instruction, 

(3) Substantial proportions of teachers saw a need 
for improvement in the following: 

, Training of teacher aides 

, Accessibility of supplies 

, Provision of planning time 

, In-service training 
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. Teacher involvement in decision nakinji 
. Communication amonj» teachers, administrators 
and liaison personnel 

(4) Accordinn to the teachers, the major problems 
facing the program were the following: 

. Communication and cooperation anonfr teachers 
administrators and liaison personnel 

• Selection of staff who are willing to put 
forth the effort and commitment needed for 
program success 

. Administrative and liaison leadership 

(5) Teaciiers' overall attitude toward the MRS Program 
was positive but a majority indicated a need for 
program modification. 



EVALUATION QUHSTION 3 
tfERE THE PirPIL OBJECTI\T:S ATTAINED? 

Pupil Objective 1; MES Superiority in Reading and Math Achieve^ 

roent Levels. '' 

a. Data Collection 

In order to assess the impact of the MES program on 
achievement in basic academic skills areas, comparisons were 
made between MES and Control schools on performance on the • 
Reading and Arithmetic subtests of the Stanford Achievement 
Tests. The tests were administered to a sample of children 
from Grades 2, 4 and 6 in hJES and Control schools in September, 
1971 and again in May, 1972. 

Data were collected from students in Regular classes 
only. Students in any kind of special class such as Major 
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Work, Enrichncnt, Listening Post or BtR were not tested. 
Table 18 sliows the level and form of the tost administered to 
eacli grade level and the number of students included in tlie 
analysis of the data. 

Table 18 



Form and Level of Stanford Acliievencnt Test Administered 
to Grades 2, 4, and 6 in ?fl:S and Control Schools, 
and Size of Saraple Tested 



Grade Level 




e Size 


Level and Fom- of Test 


M1:S 


Control 


2 


89 


106 


Pre-Prinary I, Torn X 
Post-Prinar>' II, Fom W 


4 


72 


100 


Pre-Intemediate I, Fom X 
Post-Intemediate I, Form W 


6 


73 


129 


Pre-Intemediate II, Fom X 
Post-Intemediate II, Fom W 


Totals 


234 


535 





Data analysis was performed on the scores of only 



those children for whom both pre and post test scores were 
obtained. Consequently, the results reflect the achievement 
of only those students who attended MHS or Control schools 
for the nine-month period from September, 1971 to May, 1972. 

Data analysis was performed on the raw scores at- 
tained on the tests, i.e., the number of correct responses. 
Raw scores on the Stanford Achievement Tests are often trans- 
formed into grade equivalent scores to show a student's per- 
fonnance relative to the national norms. Grade equivalents 
are very useful for descriptive purposes, but because they 
are not an equal-interval scale^ raw scores were preferred 
for statistical analysis. 
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MES and Control scliools were compared with respect 
to post-test achievement scores. To avoid the problem of the 
post score differences beinf merely a reflection of initial 
differences in pre scores, the data were analyzed by means of 
multivariate analysis of covariance (NIANCOVA). MANCOVA de- 
termines the effects that selected variables (covariates) may 
have on post scores and adjusts the data for these effects 
before making comparisons. In the present analysis the 
students* pre-test addevement scores and their PLR scores 
were used as covariates, and the MES and Control schools were 
compared on post test performance after adjusting for the 
effects of the covariates. 
b. Reading Achievement 

Table 19 shows the results of comparisons between 
the post-test reading performance of MES and Control children 
in grades 2,4 and 6. In the analysis, reading pre test scores 
and PLR scores viere used as covariates. Pre test scores were 
adjusted for unequal N, and post scores were adjusted for un- 
equal N and the effects of the covariates. Full st tistical 
data appear in Appendix F. 

Table 19 

Mean Adjusted Post Reading Subtest Scores for Children in 
Grades 2, 4 and 6 in MES and Control Schools 



MfcAN READING SUr>Ti:ST SCORES 







Word .Meaning 


I'aronr.Toh Meanin?: 


Grade 


GrouD 


Post 


Superior 
Group 


Post 


Superior 
Group 


2 


MES 

Control 


17.6 
15.2 


MliS* 


25.4 
23.8 


None 


4 


MBS 

Cnntrol 


16.7 
IS. 3 


None 


23.5 
22.4 


None 


6 


MIIS 

Control 


19.5 
17.5 


Ml-S* 


26.7 
25.3 


None 



*i2,<.oi 
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The table shows that cliildren in MHS schools scored sig- 
nificantly hipher than children in Control schools on the Word 
Meaning subtest at Grade 2 and Grade 6. Tlierc was no difference 
in performance on tlie Paragraph Meaning subtest at any of the 
three grade levels. The differences in reading performance be- 
tween MES and Control schools we.e less clear in Year 3 than the 
previous year v/hcn the MES children scored significantly higher 
than Control children on all reading subtests in two out of the 
three grade levels tested. and on one subtest in the remaining 
grade level. 

At Grade 4 a Sex x Treatment interaction that ap- 
proached significance was obtained on the Word Hcaning subtest. 
The interaction effect is illustrated in Figure 1. The inter- 
action showed that the lack of a significant difference between 
MOS and Control schools was due to the relatively good perform- 
ance registered by Control boys. (Full statistical data on the 
interaction are available in Appendix C.) 



o 
u 


17- 






o 
u 


16. 






1 Raw 


15- 






o 


14. 


1 


ft 






Girls 


Boys 



Fig. 1. Sex X Treatment Interaction on 
Word Meaning Subtest at Grade 4. 
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In order to show the reading performance of the 
MES and Control children in relation to j^rade level norms, the 
pre and post raw scores were transformed into prade equivalent 
scores and are presented in graphic form in Figure 2. The re- 
sults for the three j^rade levels are plotted on the same scale 
so that the relationship between performance and the ncrms will 
be comparable amonp grade levels. In reading the figure, two 
points should be kept in mind: Grade equivalent scores are not 
an exacts reflection of the raw score obtained on the test and 
at times will not accurately reflect differences in raw scores. 
Further, the grade equivalent scores used in Figure 2 were 
computed from the observed raw score means, not from the means 
used in the analysis, which were adjusted for the effects of 
unequal N and covariates. 

Figure 2 shows both MF.S and Control children per- 
forming a year or more below grade level in Grades 4 and 6 with 
little progress toward the norm during the year. Performance 
at' Grade 2 was somewhat better for both MFS and Control children, 
with the mean MI:S score on the Word Meaning subtest matching 
the grade level norm. It is further evident that the per- 
formance deficit increased as a function of grade level. 
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Word Meaning 



• .MRS X K Control 

Gr.- 2 Paragraph Meaning 



cl 



IS 

c 
o 



2.8 
2.4 
2.0 
1.6. 




Pre 




Post Pre 
Test Date 



Post 



o 
> 

•H 

d 



4.6 
4.2 

3.4- 
3.0- 



Kord Meaning 











X Z'-^^'^^^^^^ 








• 






i r 



Pre 



Post Pre 
test Date 



Post 



Word Meaninr: 



Gr. 6 Paragraph Meaning 



u 

c 

O 



6.6 
6.2 

5.8J 

5.4 
5,0. 
4.6, 
4.2. 




J. 



Pre 



Post Pre 
Test Pate 



Post 



Fig. 2. Mean Reading Grade Equivalent Scores for MES and Control Children in 
Grades 2, 4 and 6 in Year 3, 
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c. Math Achievcncnt 

Table 20 shows the results of copiparisons between 
the post test math perfomances of MHS and Control children 
at the three grade levels tested. In the analysis, nath pre 
te^t scores and PLR scores were used as covariates. Pre 
scores were adjusted for unequal N, and post scores were 
adjusted for unequal N and the effects of the covariates. 
Full statistical data appear in Appendix F. 
Table 20 



Mean Adjusted Post Math Subtest Scores for Children 
in Grades 2, 4 and 6 in MHS and Control Schools 











M'Vni 


SUETHST SCOni-S 








(.onputations 


Concents 


Annl ications 


Gr.ide 


Group 


Post 


Superi or 
Grouii 


Post 


Superior 
Groun 


Post 


.Superior 
Groun 


2 


MES 

Control 


23.2 
18.4 


MES* 


17.5 
14. n 


MP.S* 






4 


MHS 

Control 


18.3 
17.5 


None 


15.1 
12.3 


MI-S* 


11.5 
10.3 


None 


6 


MHS 

Control 


16.5 
17.9 


Con- 
trol** 


13.9 
12.8 


MKS** 


15.1 
14.1 


None 



**p<.05 

The table shows that NfES children scored si^^nifica* ♦:ly 
higher than Control children on the Concepts subtest at all 
three grade levels. On the Computations subtest, ^ffiS children 
scored higher at Grade 2 and Control children scored higher at 
Grade 6. There were no differences at any grade level on the 
Applications subtest. V/ith respec j grade level these results 
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can be characterized as scattered except at Grade 2 where a 
clear ^fES superiority in math achievenent was evident. With 
respect to areas of math performance, the results indicate 
clear MES superiority on Arithmetic Concepts, 

Figure 3 shows the mea i pre and post math jjrade 
equivalent scores of MES and Control children in Grades 2, 4 
and 6 in relation to the grade level norms. The figure shows 
that both MES and Control children performed closer to norm 
level on the math subtests than they did on the reading sub- 
tests. At Grade 2 the average score of MES children was at 
or above the norm on both math subtests, and the superiority 
of the MES group was evident at this grade level. The figure 
also shows a performance deficit again increasing as a function 
of grade level for both MES and Control children. 
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Fig. 3. Mean Matli Grade equivalent Scores fo;r MHS and Control Children 

in Gravies 2, 4 and 6 in Year 5. 
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Boys vri> nirls 

Examination of the readinp, and matli acliievement 
data for sex differences revealed a significant difference 
on only one subtest at one grade level. In Grade 2, boys 
scored significantly hi;:lier than girls on the Computations 
subtest. Statistical data appear in Appendix H. 
Benesch vs, Wooldridge 

The reading and math achievement data were examined 
for differences between the two MRS scliools, and several sig- 
nificant differences were found. At Grade 2 the children in 
Benesch scored significantly higher than the children in Wool- 
dridge on all reading and math subtests. At Grade 4 the 
children in Benesch scored significantly higher than the 
children in Kooldridge on tlirce out of tlie five subtests 
administered. These subtests were Paragiaph Meaning, Arith- 
metic Computations and Arithmetic Concepts. At Grade 6 the 
children in Wooldridge scored significantly higher than the 
children in Benesch on three out of the five subtests adminis- 
tered: Word Meaning, Arithmetic Concepts and Arithmetic Ap- 
plications. Overall, perforr.iance appeared better at Benesch 
at the middle and lower grade levels, and better at Wooldridge 
at the higher grade levels. Statistical data appear in Appendix 
Summary of Achievement Data 

Table 21 summarizes tlie nunber of reading and math 
subtests on which the MiiS children at each grade level scored high- 
er than Control children. The table shows the results as 
reported in each of the three yejirs of program operation. 
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Table 21 

Number* of Readinp and Math Subtests on Which MHS 
Children Scored lii.Tiier timn Control Children at 
liach Grade Level in liach Year of Operation 



Year 1 


1 Year 2 


Year 3 


Readinj', flath 
Grade Subtests Subtests 


1 Keadmj! Jhtli Reading Math 
1 Grade Subtests Subtests Grado Snhtr^ctc q„j,»-ftc«-e 


2 1/2 1/2 
4 1/2 3/3 
6 0/2 0/3 


1 0/2 0/1 
3 2/2 1/2 
5 2/2 2/3 


2 1/2 2/2 
-1 0/2 1/3 
6 1/2 1/3 



♦Denoninators refer to the number of subtests administered, and nunorators 
represent the number of subtests on which MHS children scored higher. 

The table shows that there has been some slippage since Year 

2 in the number of times MES children scored higher than 

Control children in reading. In math there is again $one 

slippage at the middle and upper grade levels. Another way 

of looking at the data, however, is to compare Year 3, Grade 2 

with Year 1, Grade 2, etc. This cross sectional comparison 

shows that in reading the margin of superiority remained the 

same at Grade 2, was eliminated at Grade 4 and improved at 

Grade 6, In math the cross sectional comparison shows im- 

provement at Grade 2 and Grade 6 and slippage at Grade 4, 

The results can only be characterized as mixed, and the 

achievement objectives must be judged only partially attained. 

Pupil Objec tive 2; Increase in Pupil Attendance Pates in M HS 

Schools'^ " ' — 



Pupil attendance rates for the ^^ES schools were gathered 
for the school years 1965-66 through 197U72. The data were 
analyzed in two ways: 
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a. The mean attendance rate in MES schools durinf: Yea? 3 
was compared with t;ieir wean rate durino Years 1 and 
2 and durinj: tnc previous four school years. The sane 
comparisons were made on the city-wiue attendance rate. 

. b. The ruean attendance rate of MliS schools during Year 3 
was compared with the r-caa city-wide attendance rate 
for the same period. A similar cormarison was made 
for Years 1 and 2 and the previous four school years. 



Comparisons of attendance rates were made by means 
of the t^ - test. (Statistical data appear in Appendix J.) The 
attendance rates for the MES schools and city-wide schools for 
the three time periods considered are presented graphically in 
Figure 4. 



Bcpin 
MES 




-i 1 1 i 1 ' 

65 66 67 68 69 70 71 



I I I I I t t 

66 67 68 69 70 71 72 

School Year . 



Fig. 4. Mean Attendance Rates City-Wide and 
for MRS Schools 
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Figure 4 shows that the mean attendance rates city- 
Kidc and for the fms sdiools declined throuph Year 2 of the pro- 
gram and then rose in Year 3. Despite tne rise in attendance rates 
in Year 3, the mean rate in Year 3 was significantly lower than 
the mean pre-prograra rate, both city-wide and for the MES schools. 
There were no significant differences between the city-wide at- 
tendance rate and the rate in MES schools either before or after 
the program began. However, the rise in the city-wide rate between 
Year 2 and Year 3 was statistically significant, while the rise 
was not significant for tlie MHS schools. The attendance pattern 
in Figure 4 suggests that whatever variables have affected city- 
wide attendance rates have affected the MHS attendance rates in 
the same way. There is no evidence to date that the MES Program 
has had any effect on attendance rates in the schools served. 
Objective 2 was not achieved. 

Pupil Objective 3; The Incidence of Parent Teacher Meetings win 

Increase Heyond I'rcvioiis Levels. 

a. Data Collection 

Each cluster was to keep records of group parent 
activities conducted at the cluster level, recording the 
nature of the activity and the number of parents attending. 
Records were also kept on the number of parents attending 
school-wide activities such as open house. The accuracy of 
the data that follow is dependent, of course, on the com- 
pleteness of the records submitted by the schools. 

b. Parent Attendance at Cluster Activities 

Individual clusters conducted a wide variety of 
parent involvement activities ranging from question and an- 
swer meetings about the MES Program to an odds and ends sale. 
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All of the clusters at Bcncsch and two out of the three 
clusters at KooldridRC conducted at least one parent in- 
volver.ent group activity uurinR the year. The number of 
activities onducted by each cluster ranged from one to seven 
anu averaged two to three per year. 

Attendance at the group activities conducted by 
the clusters at Benesch averaged 32 parents per cluster activ- 
ity or roughly 48*5i of the potential participants. At IVooldridpe 
the attendance was sowev/hat lower, averaging 10 parents per 
cluster activity or roughly 20%. The data indicate that Benesch 
parents were r.ore responsive to cluster efforts to bring ther: 
into the school than Wooldridge parents, 
c. Parent Attendance at School^Kide Activities 

More data are available from Benesch on parent at- 
tendance at school-wide activities than from Wooldridge. 
Table 22 shows various types of schooUwide activities and 
the average parent attendance at each. It is impossible to 
report parert attendance in terms of the percentage of parents 
attending because there is no way of determining whether the numbers 
include one or both of a child's parents. The table shows that 
Table 22 



Parent Attendance at School«>Wide Activities 



Type of Activity 


Average Parent Attendance 


Benesch 


i/ooldridge 


Open }Iou«;e 


552 


300 


PTA General Meetings 


20 


* 


School Programs and 
Assemblies 


80 


* 


TOTAL AViiRAGE 


115 





*Data not available 
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by far the most successful activities in terns of parent 
attendance were the open houses and the least successful were 
PTA meetings. In comparing the data fron the tv.o MHS schools, 
it should be kept in nind that iienoscU has rouehly tidce the 
student enrol Inent of Uooldridge, 
d. Parent Volunteers 

Another index of parent involvement in the W.S school 
is the number of parents who volunteered to assist in the class 
room. At Wooldridpe there were 25 volunteer tutors contribut- 
ing an average of approximately 40 hours each during the 
school year. At Benesch 16 parent volunteers worked an 
average of 14 hours each. 

The basic problem facing the MHS staff as reported 
by program administrators has been in overcoming parents' re- 
luctance to come to the school in the first place, much less 
take an active part in educational activities. Consequently 
many of the parent involvement activities have been designed 
to simply get the parents into the school. From there it is 
hoped that as they begin to feel more comfortable about cominr 
into the school, they can become progressively more involved 
in their childrcns* education. 

The data available to date indicate that the two 
schools are making progress in the first phase of this effort. 
Objective 3 was attained. 
Pupil Objective 4; MRS Sup eriority in Attitude Toward Schools 

As of this writing, the analysis of data on the attitudes 
of MES and Control children is incorm^lete. The results of the 
analysis will be appended to this report at a later date. 



•S. Slunnary of Question 3: k'crc the Punil ObTcctivcs Attnino.?^ 



The data collected relative to Hvaluation Question 3 show 
that progress toward achievenent of the four pupil objectives in 
Year 3 was limited. 

^- Objective 1; MHS Superior ity in Achievenent in Readinr and 
Math — ^ 

Analysis of the results of standardized achievenent 
tests administered to ?niS aad Control children in Grades 2, 4 
and 6 showed that the achievement objectives were only partial- 
ly attained: 

(1) Rcridine 

The MKS children scored significantly higher than the 
Control ciiildren on the Ivord Meaninr' subtest at Grades 
2 and 6. Tiicre were no differences in perforinance on 
the Parajrraoh Meaning subtest at any rrade level, liy 
grade level, tne MHS children scored higher on one out 
of two tests at Grade 2, none out of two tests at Grade 
4 and one out of tv:o tests at Grade 6. This perforr^-ince 
v/as conparatively x:orsc than the previous year when ?fl:5; 
children scored aif.aer on both subtests at two prade 
levels and on one subtest at the renaininji prade level. 

(2) Math 



The MHS cliildren scored significantly higher t!ian the 
Control cliildren on the Concepts subtest at all three 
grade levels. On the Connutations subtest, MliS children 
scored sif.nificantly hij:her at Grade 2, but Control 
children scored higher at Grade 6. There was no differences 
on the Applications subtest, by grade level the MHS child- 
ren scored Jiir^her on two out of tWo tests' at Grade 2, none 
out of two tests at Grade 4, and one out of three tests at 
Grade 6. 

^* 0>^jective 2; Sjf^nificant Increase in Attendance Rates in rms 
Scnoolsl^ ' ' ' 

Analysis of attendance data Collected for the three 

years of propran operation and for the four years prior to 

propran implementation showed that thp attendance objective 

wa,; not acliioved: 
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(1) Attendance rates both city-wiile and in the ^ff:S scliools 
were sif.nificantly lower in the tiilrd year of operation 
than befo/c the rnonran began. 

(2) There is no evidence that t!ie MliS Pronran has had any 
effect on the attendance rates in t!ie schools served'. 

Objective 3; Increase in Incidence of Parent>Teachcr Mcetinr s 

Data coUecte-J throupii teacher loj!S of parent at- 
tendance at cluster activities and records of parent attendance 
at schooUwide activities showed that the objective was achieved 

(1) Clusters conducted an average of two to tliree parent 
involvencnt activities per year ppr cluster. 

(2) Parent attendance at cluster activities averaged 
approxinatcly 48% of the potential participants at 
Bencsch and 20% at UooldriJge. 

(3) The nost successful schooUv;ide activities in terms 
of parent attendance were open houses, "Hie activities 
drawing the fewest parents were PTA neetinps. 

Objective 4: ?!i:s Superiority in Attitude Toward School 

Analysis of attitude data v;as incomplete as of this 

writing. 
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EVALUATION OlJIiSTION 4 

miAT HAS BlillN THE IMPACT ON AGlIEVIiMI-NT LEVELS 
OVER THE niREE YEARS OF OPERATION OF TIIE PROGRAM? 

General Procednrcy 

To determine the impact on reading and math achievement 
over the full tliree years oi operation of the MES Program, two 
types of analysis were conducted. The first was a longitudinal 
analysis in which the achievement perfomance of a group of 
children was monitored tliroughout the three years of operation. 
The second analysis was cross sectional and involved nionit-orinp 
changes in the aciiievement levels dcnonstratcd at certain grade 
levels across tiie three years of prouran operation. 
Longitudinal Analysis of Achievencnt 
a. longitudinal Data Collection 

The schedule of achievement test administration over 
the three years of operation of the MES I rogram was designed 
to allow an examination of tlie performance of MES and Control 
children on a longitudinal basis. The grades tested during 
each year of program operation and the number of children 
for whom data are available over the three year period are 
presented in Table 23. (The form and level of the tests 
administered at each grade in each year are available in 
Appendix K.) 



Table 23 

Grades Involved in Ac.iiwenicnt Testing Over Three 
Years of Operation of the MHS Froeran 



flracics Tested 


Longitudinal Sar.nle 
Size 


Year 1 Year Year 3 


MHS 


Control 


Gr. 1 Gr. 2 


51 


54 


Gr. 2 Gr. -3 Gr. 4 


48 


58 


Gr. 4 Gr. 5 Gr. 6 


33 


61 


Gr. 6 







Table 23 shows that the schedule of achicvcncnt 
testing generated three longitudinal sanples. Two years of 
data arc available on children who began the program in 
Grade 1, Year 2 and completed Grade 2, Year 3 (1-2 longi- 
tudinal sample). Three /ears of data are available on children 
who began the progran in Grade 2, Year 1 and who conpleted 
Grade 4, Year 5 (2-5-4 longitudinal sample). Three years 
of data are also available on children who began the progran 
in Grade 4, Year 1 and conpleted Grade 6, Year 3 (4-5-6 
longitudinal sarple). 

The longitudinal analysis was performed on the 
achievement data of only those children who were enrolled in 
the MKS and Control schools during the entire longitudinal 
tide frame. Children who entered or left the schools during 
the longitudinal time frame were not included in the analysis. 

An important point to be remembered in interpreting 
the longitudinal analysis is that the combination of high 
pupil mobility rates and imperfect data retrieval methods 
resulted in a decrease in Vac size of the longitudinal sample 
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each year. Consequently, the number of children in the longi- 
tudinal samples after three years represented only a little 
over one third of the children who were orif'inally enrolled 
in the schools. The rest of the original enroUees had either 
left the schools or did not have complete achievement data* 
The sample that remained represented the most stable elements 
of the pupil population in terns of nobility and was in that 
sense a biased sample. The possible effect of this bias on 
achievement results is unknov;n. 
Longitudinal Analysis - Readin5! 

Multivariate analysis of covariance was performed 
on the mean Year 3 post reading scores of MHS and Control 
children in the Grade 1-2, Grade 2-3-4, and Grade 4-5-6 
longitudinal samples. Year 1 PLR scores and reading pre 
scores were used as covariates for the Grade 2-3-4 and Grade 
4-5-6 samples. Metropolitan Reading Readiness Test Scores were 
used as covariates for the Grade 1-2 sample. Table 24 shows 
the mean post raw scores adjusted for unequal N and the effects 
of covariates. Full statistical data appear in Appendix L. 



^ 83 . 



Table 24 

Mean Post Reading Scores for ^f^S and Control Children in the 
Grade 1-2, Grade 2-3-4 and Grade 4-5-6 Lonritudinal Sanples 



Sample Group 



Mean Vosz Ke;Miin^ Scores 



V.'ord 
Mean in r 



Superior 
Group 



Paragraph 
Meaninf! 



Superior 
(iroun 



1-2 



MKS 

Control 



18.0 
16.6 



None 



25.1 
26.7 



None 



2-3-4 



MliS 

Control 



17.4 
16.2 



None 



24.9 
23.1 



None 



4-5-6 



MKS 

Control 



23.7 
17.4 



*£<.0006 
*£<.08 



29.5 
25.3 



The table shows that of the three lon^^itudinal 
samples, sipnificcint differences between the reading perfomances 
of MES and Control children occurred only in the Grade 4-5-6 
sample. Here MHS children :.:orcd significantly hiphe^. than Control 
children on the Word ?feaninp subtest, and on the Pa-apraph Mean- 
ing subtest. The difference in favor of MLS children approached 
statistical significance* 

In order to show reading performance in relation to 
grade level norms, the reading grade equivalent scores of the 
MI'S and Control children in the longitudinal samples are pre- 
sented in Figure 5. The figure shows the grade equivalent 
scores attained in each year of program operation. 

The figxirc s!iows that in the Grade 1-2 sample, after 
two years in the MHS program the average score of the MES 
drldren was at norm level on the Word Meaning subtest, al- 
though Control children were only one month behind. On the 
Paragraph Meaning subtest, iiowever, MES children had fallen 
four Hionths bcliind the norni by tiic end of two years in the 
program. 
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4- 



Gr. 2 Gr. 2 Gr. 3 Gr. 4 Gr. 2 Gr. 2 Gr. i Gr. 4 
Pre Post Post Post Pre Post ^^ost Post 
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> 

•rl 



u 
c 
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6.4. 

5.8. 

5.2 

4.6. 

4.0. 

3.4. 

2.8, 



Gr. 4-5-6 Sanplc 
V.'ord Meaninp Paragraph Meaning 




ir.' 4 lir. 4 dr. 5 Gr. 6 




or. 4 (,r. 4 Cr. 5 Gr'. 6 



Pre Post Post PoFt Pro' Po<:'»- Post Popt 



Fig. 5 Mean Reading i;rade Hquivalcnt Scores for 5 Lonnitudinal Samples 
of MKS and Control Children. 
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In both the Grade 2-3-4 and the Grade 4-5-6 samples, 
the figure shows a pattern of increasinp perfornance deficit 
as the children progress through the grades. The deficit* is 
of about the same magnitude for MES and Control children in 
the Grade 2-3-4 sample but is less for the ^^^S children in th- 
Grade 4-5-6 sample. In the Grade 2-3-4 sample, MHS children 
havinf had program services for three years were roujihly one 
year behind the norms. In' the Grade 4-5-6 sample, the MES 
children were up to one and one lialf years behind the norms 
after thtee years in the program. 
Lonnitudinal Analysis - Math 

Multi" riatc analysis of covariance was performed on 
the mean Year 3 post matli scores of ms and Control children in 
the three longitudinal samples. Year 1 PLR scores and math pre 
scores were used as covariates for the Grade 2-3-4 and Grade 4- 
5-6 samples. Metropolitan Reading Readiness Test scores were 
used as covariates for the Grade 1-2 sample. Table 25 shows 
the mean post raw scores adjusted for unequal N and the effects 
of the covariates. Full statistical data are available in 
Appendix L. 
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Table 25 

Post Mean Hath Scores for ^ES and Control children in the Grade 
1-2, Grade 2-3-4 and Grade 4-5-6 Longitudinal Samples 



.Mean Fnsi .'latn .scores 



Sample 


Group 


Compu- 
tations 


Superior 

GrOUr) 


Con- 
cents 


Superior 
Groun 


Appli- 
cations 


Superior 
Group 


Gr. 1-2 


MES 

Control 


22.7 
19.1 


MES* 


17.9 
15.2 


MRS* 






Gr. 2-3-4 


^!ES 

Control 


17.0 
19.7 


Control** 


14.6 
14.2 


None 


10.9 
12.5 


Control** 


Gr. 4-5-6 


MES 

Control 


17.3 
18.7 


None 


14.8 
13.6 


None 


16.6 
14.9 


None 



*£<.03 
**£ <.06 



Table 25 shows that the only sit^nificant differences 
in favor of MES on the nath subtests occurred in the Grade 1-2 
sample where the MRS children scored sijjnificantly higher on 
both the Conputations and Concepts subtests. In the Grade 2-3-4 
sample the Control children scored higher on the Computations 
and Applications subtests, the differences approaching 
statistical signifij:ance. There were no differences in the 
Grade 4-5-6 sample. 

To show the math performance of the longitudinal 
samples in relation to the grade level norms, the average raw 
scores of the ftnS and Control children were transformed into 
grade equivalent scores. These are presented* for each year of 
program oporation in Figure 6. 
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The fifTure shows that at the end of two years in 
the }\ES Program the MES children in the Grade 1-2 saniplc were 
performing at the grade level norm on both the Computations and 
Concepts subtests. 

In the Grade 2-3-4 sample the performance of both ^LS 
and Control children was closer to the norm on the Computations 
and Concepts subtests than on the reading subtests with the MRS 
children performing at the norm level on the Concepts subtest. 
On the Applications subtest, however, both groups were almost 
a year behind the norm level. 

In the Grade 4-5-6 sample the MES children maintained 
a clear superiority on all :hrec math subtests during the 
first two years of the program. On the Computations and 
Concepts subtests they performed above the norm level, and on 
the Applications subtest they appeared to be moving towards 
the norm. In Year 3, however, their performance suddenly drop- 
ped back to the level of the Control children or below, so 
that they were a year or more behind the norms. 
Summary of Longitudinal Analysis 

Table 26 summarizes the number of reading and 
math subtests on which the MES children in the longitudinal 
samples scored significantly higher than Control children. The 
table shows the results for each sample ap reported in Year 2 
of the MES program and again in Year 3 when an additional year 
of data was available on each sample. 



- 89 - 



Table 26 

Number* of Readinp and Math Subtests on Which Mf-S Children 
Scored Higher than Control Children in the Longitudinal Sample: 



Pro 


jrram Year 


2 


I'ror^ran Yenr 3 


Longitudinal 
Stimple 


Reading 
Subtests 


Matn 
Subtests 


Longitudinal 
Samnle 


ReadinR 
Subtests 


Math 
Subtests 








Gr. 1-2 


0/2 


2/2 


Gr. 2-3 


2/2 


0/2 


(Jr. 2-3-4 


0/2 


0/3 


Gr. 4-5 


2/2 


3/3 


Gr. 4-5-6 


2/2 


0/3 



♦Denoninators refer to the nunber of subtests administered and 
numerators represent the number of subtests on which MHS children 
scored higiier. 



The table sho\;s that the overall performance 
superiority of the MES children in the lonpitudinal samples 
was less impressive after three years of the ^tES Program 
than it was after two years of operation. In Year 2 the Grade 
2-3 MES sample showed a clear superiority over tlie Control 
sample in reading, but lost it in Year 3. In Year 2 the Grade 
4-5 sample showed superior performance on all subtests in read- 
ing and math, but in Year 3 showed superiority only in readiTijr. 

It should be noted that the longitudinal sample at 
the end of Year 3 is not exactly the same group of children as 
the sample at the end of Year 2 because of pupil mobility. As 
mentioned? earlier, with each succeeding year the group of 
children in both MKS and Control schools w!io have been there 
since the program began gets smaller and more select. Re- 
stricting the longitudinal sample to geographically stable 
students may introduce a bias, the extent and effect of which 
is not known. 
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3» Cross Sectional Analysis of Achicvencnt 
a. Cross Sectional Data Collection 

The cross sectional analysis of achievement atter.pts 
to answer the following type of question: After three years 
of operation of the MES Pronram, how are children in Grade 3 
performing as compared with the perfomance at Grade 3 when tho 
program bcRan? Cross sectional grade level comparisons of this 
sort were made usinp the results of the reading and arithmetic 
subtests of t!ic California Tests of Basic Skills (CTBS) obtained 
through the city-wide testing program. Mean scores on the 
subtests were obtained for the mS schools, the Control schools 
ard for all 30 Title I target schools. The test results from 
the 1969-70, the 1970-71 and the 1971-72 school years (Years 1, 
2 and 3 of the MES Program) were examined at Grades 3, 5 and 6. 
The use of these years and ^jrades was determined by the city- 
wide testing schedule. Baseline data are not available 
for the years preceding the ^^E^) Program because the CTBS was 
not used in the city-wide testing program until the first year 
of MF.S. 

b. Cross Sectional Analysis - Readini! 

Figure 7 shows the average reading performance 
levels of children in Grade 3, S and 6 in the HHS schools, 
the Control schools and the Title I target schools\SuVing 
each of the three years of operation of the MHS Program. 
Because test dates sometimes varied, the data are presented 
in the form of grade equivalent months deviation from the r:>rm 
rnthor thnn ^^'^de equivnlent ?cor<:>c. fino tn tho lack of 
statistical control on these data, apparent differences in the 
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Fig, 7. Performance Levels in ReadinR at Three Grade Levels Across Three Years 
for MUS, Control and 30 Title I Target Schools. 
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perfornancc level between groups at a given point in time 
should not be interpreted. too strictly. What is of interest 
is the pattern of performance by each group across the three 
years. 

At Grade 3 performance changes on the Vocabulary 
subtest across the three years were identical for MHS and 
Control schools, rising between Year 1 and Year 2 and remain- 
ing unchanged from Year 2 to Year 3. The average performance 
in the 30 Title I target schools rose steadily over the three 
years. On the Comprehension subtest, the performance in - 
Control schools and the Title I target schools rose in Year 
2, but fell again in Year 3. In MES schools there was no 
change in performance from Year 1 to Year 2, and performance 
levels dropped in Year 3. In general, changes in t]ie reading 
performance levels in MES scliools at Grade 3 appeared to 
differ little from the changes observed in the Control and 
other Title I target schools. 

At Grade 5 data were available for only two years. 
Year 1 and Year 2 of the IfES Program* Across those two years 
the figure shows that performance levels in the Control schools 
dropped on both reading subtests and the performance in the 
target schools remained unchanged. The reading performance of 
MES fifth graders, however, rose between Year 1 and Year 2. 

At Grade 6 the performance of all three groups rose 
from Year 1 to Year 2 on both reading subtests. In Year 3 MES 
performance continued to rise while that of the Control and 
other target schools declined. In Year 3 the average 
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performance of iffiS sixth graders on the Comprehension sub- 
test was six months higher than that of MI;S sixth graders 
in Year 1. 

In summary^ the reading performance data indicate 
that the average performance levels in MBS schools are slow- 
ly rising at Grades 5 and 6, but not at Grade 3. Despite the 
rise, MES children were still performing a year and a half or 
more below grade level at Grades 5 and 6. 
Cross Sectional Analysis - Math 

Figure 8 shows the average tiath performance levels 
of children in Grades 3, 5 and 6 during eacli of the three 
years of the operation of the MHS Program, Again, the data 
are presented in the form oif grade equivalent months de- 
viation from the norm. 

At Grade 3 changes in math performance across the 
three years of the MKS program were mixed. In the ?^ES schools 
the performance level rose each year of the program on the 
Computations and Applications subtests. These rises were 
generally paralleled, however, by the average performance 
levels in the other Title I target schools. On the Concepts 
subtest MF.S performance levels rose in Year 2 but fell again 
in Year 3. Again the changes were fairly well paralleled by 
the Control groups 

At Grade 5 ^n•S performance levels on the Concepts 
and Applications subtests rose in Year 2 and fell in 
Year 3. Performance remained essentially unchanged on the 
Computations subtest. Performance across the three years in 
the Control and other target schools either remained the same 
or fell. 
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At Grade 6 MES performance levels on Computations 
and Concepts rose steadily over the three years of the program, 
but changed little on Applications. The Control groups' per- 
formance paralleled the MDS rise in Year 2 but fell in Year 3. 

In summary, performance levels in math were observed 
to be generally rising at Grade 6 but not at Grades 3 and 5, 
Summary of Cross Sectional Analysis 

In examining changes in reading and math performance 
at three grade levels over the course of three years of opera- 
tion of the MES program, any such changes must be interpreted 
in light of the changes occurring in other schools. In this 
cross sectional look nt achievement the clearest results 
occurred at Grade 6 where a gc:ieral pattern of slowly improving 
performance in MES schools took place in the face of generally 
declining performance in other schools. The same pattern 
held for reading performance at the fifth grade level, al- 
though lack of data prevents examination of performance over 
the full three years. Similar results were found in math 
performance at Grade 3 but these were paralleled by similar 
changes in other schools. Other changes in MES performance 
also were generally paralleled by similar changes in other 
schools. Despite the gradual rises in achievement levels, 
performance was still well below grade level norms in 
most cases. 



• 96 - 



CONCLUSIONS AND RECOJtlENDATIONS 

A» Discussion of Results 

This report is the evaluation of Year 3 of the MES Program, 
but any discussion of results must be undertaken in the context of 
the preceding two years of operation. During the first year of the 
program, implementation of the proposed changes in school organiza- 
tion and procedures must be characterized as less than smooth. (One 
wag was heard to remark at the time that an accurate definition of 
the program could be had simply by adding another to the acronym.) 
Cluster operation during the first year was generally rated as in- 
effective, and teachers were judged as not making productive use of 
program resources. Effective use of new equipment and materials 
was observed infrequently, and the small class size was not seen to 
be of much benefit in most lessons observed. However, when the pro- 
gran first began, few people involved really quite understood their 
roles in it, how they were expected to use its resources, the pur- 
pose, structure and function of clusters, or in short, what the 
program was . A frequently encountered question from confused and 
frustrated teachers was, "...But what is^ MES?" Teachers thrown 
together on a cluster "team" tended to isolate themselves from 
their "teammates" and continued to function as individual teachers 
in individual classrooms, because they did not know how to do other- 
wise, and they weren't really sure of what the otherwise was. 

In many respects, theie has been marked improvement in 
program operation since its inception. By the third year over 
half of the clusters were rated by observers as having a "good" 
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overall operation, MES teachers were rated as- superior to Control 
teachers on many dimensions of teaching behavior, ranging from 
better prepared and organized lessons to using a wider variety of 
methods and materials. This superiority was directly related by 
observers to the greater resources available to them. MHS 
teachers were also observed to be working together as teams to a 
much greater extent, grouping and regrouping children within and 
among classroor^s for instruction. More effective use of instructional 
equipment was seen, and in the majority of lessons observed, the 
loss of the smaller class size would have seriously impeded the 
effectiveness of instruction. 

Overall, the three years of the MES Program have seen a 
gradual movenenc from an operation that was confused and lacking 
in definition, with an abundance of equipment, materials, small clas- 
ses and supportive personnel that few teachers knew how to use, to 
an operation that is more clearly defined in terms of organization 
and procedure, with a staff that has shown considerable growth in 
terms of understanding how to use program resources. Some measure 
of the improved understanding of the staff regarding how the pro- 
gram was intended to operate ir» reflected in the changing nature 
of the complaints teachers have made over the three years. In 
the first year teacher concerns centered most often on things ; not 
enough equipment, not enough materials, not enough staff. By the 
third year, their attention had shifted away from such surface 
elements to a primary concern with selecting staff with the 
philosophy and commitment necessary to make the program work. To 
one who has observed the program from^ the beginning, the shift 
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represents a growing insifjht on the part of the teachers that 
showering a school with material goodies will affect teaching 
only to the extent that teachers make effective use of then, * 

Although there has been considerable improvement in 
program definition and effective use of resources, certain pro- 
blems have remained since the program began, including lack of 
communication and cooperation among teaciiers and school and 
program administrators, teacher dissatisfaction with the com- 
mitnent of teachers selected for the program, teacher dissatis- 
faction with program* leadership, and teacher dissatisfaction with 
the extent of their involvement in decision making. These are 
issues identified by the MES teaching staff themselves, and al- 
though they did not appear overwhelming, they were mentioned with 
siifficient frequency to warrant consideration. With respect to 
lack of cooperation, it should be noted that this problem does 
not appear as serious as in previous years; the findings of 
clas/room observers certainly indicated a greater tendency for 
teachers to work together than in the past. The problems of 
communication, program leadership, staff selection and 
teacher input, however, appear more widespread. 

It is possible, of course, that in any program that re- 
quires a high degree of teamwork and which also touts freedom 
and flexibility in teaching there will inevitably be disagreement 
and conflict. It is also possible that there is no more of a 
problem in this respect in the MliS schools than in any other 
school, but that it is more visible in the MES schools simply be- 
cause program evaluation has given the teachers an opportunity to 
speak out on such issues. Whatever explanations can be devised, 
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however, the distinct possibility remains that the degree of conflict 
and dissatisfaction that exists anong the MHS staff could be a 
serious impediment to the success of the program. Just as pro- 
gram administrators iiave taken steps in the past to clariify pro- 
gram organization and procedures, so should they now address them- 
selves to these problems. 

Although progress in the implementation of the MES Pro* 
gram has been documented, the question remains as to its effect on 
the children it serves. Three indices have been taken each year of 
operation: attendance, attitude and achievement. First, with 
respect to attendance, the evidence to date indicates that the 
MES Program has had no effect on the attendance rates in the schools 
served. Second, attitude data durint^ the first year showed some 
evidence that MES children had more positive views of certain 
aspects of school than Control children, but during the second year 
the Control children appeared to have generally more positive at- 
titudes. (Attitude data for Year 3 are not yet complete but will 
be appended at a later date.) Finally, the effect of the propram 
on achievement levels remains to be considered. 

After three years of operation, the question "Has the 
MES Program had a measurable impact on improving achievement levels 
in reading and math?" must be answered with a resounding V« .Perhaps." 
During the first two years, MGS children demonstrated a decided 
superiority in achievement over Control children. Analysis of 
the performance of just those children who had been in the program 
for the full two years (the longitudinal samples) showed even 
more impressive results. In the third year of operation, however. 
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there was slippage. MES children still outperformed Control child- 
ren on several tests, but not as mny# Analysis of longitudinal 
data showed MES superiority in fewer instances than before and 
Control superiority in a few nore. Cross sectional analysis of 
changes in performance over tiir.e at given grade levels did show 
so)ne evidence of a gradual improvement in certain instances, but 
performance was still well below nam levels* 

Do the results of Year 3 indicate that the program is a 
failure? No — just as the results of the first two years were not 
interpreted as indicating an unqualified success* (Harlier reports 
cautioned against premature expansion*) The results do point up 
the difficulty in making definitive statements about the impact 
of an experimental treatment that has been in place over a rel- 
atively short period of time and whicli has operated ir the face of 
so many uncontrollable variables as are found in public school 
systems* The problem of the possible bias introduced by the neccs- 
sity of restricting longitudinal samples to the most geographically 
stable students in schools with high mobility rates has been dis-» 
cussed in the text* Conducting valid cross sectional analyses of 
progrtim effects across time at given grade levels is hampered by a 
lack of adequate baseline data due to changes in instrumentation* 
TJie differences between performance as measured by the CTBS and 
performance as measured by the Stanford serve to point up the 
caution with which such results must be interpreted* Changing 
neighborhoods result in changing school populations in both MES 
and Control schools, and the changes may not be parallel* Such 
changes can, however, affect achievement levels and the results 
of comparisons. 

- 101 • 



The point of all this is that evaluation under suc!i con- 
ditions, especially witli programs involving entire school popula- 
tions, often cannot yield quick answers • It my be that the 
achievement results in Year 3 of the MKS Proj^ran are merely a 
ripple in the stream of propress, to coin a cliciie"^ Or it may be 
that they reflect a contimiing downward trend. The answer will 
come, but it will require time for enough data to be collected so 
thnt administrators will be able to say, despite fluctuations in 
performance, .that the overall tren*' indicates that the profjram is 
or is not effective in raisinjj achi /ement levels. 
Recomnendat i ons 

1# It is recommended that the ?ins Program be continued in the 
same two schools in whicii it presently operates for the next 
two to three years until sufficient data are available for 
an accurate appraisal of lonp term profjram effects. 

2. It is recommended that a decision on expansion of the MHS 
Propram be deferred until the results of the lonp term 
evaluation are available. 

3. It is recommended that program and school administrators take 
immediate steps to improve the lines of communication among 
all levels of staff. 

4. It is recommended that a formal screening procedure be 
established so that when staff vacancies occur in the MHS 
schools, i)otential replacements will be made aware of the 
requirements involved in teaching in the ^U:S Program. 

5. It is recommended that the possibility of establishing some 
sort of transfer-without -prejudice policy limited to the 
MHS schools be explored with the Cleveland Teachers Union. 
Sucli a policy is recommended because it is evident from 
the comments of observers, teachers and administrators thnt 
there are those who may be {inc teachers in the traditional 
sense but who do not function weU in a flexible and open 
teaching situation requiring teamwork in instruction. 

6. It is recommended that training in alternative teaching 
techniques in specific subject areas be placed high on 
the list of priorities for in-service training. 
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APPENDIX A 
Descriptive Data on Project Schools 



Alfred A. Benesch Vt'ooldridsre 

Poverty Rate 72% 49% 

Mobility Rate 66% 69% 

Enrollment by Grade 

EMR 16 35 

K 87 39 

1 54 19 

2 77 48 

3 67 34 

4 68 20 

5 46 28 

6 _J4 _34 
Total Enrollment 512 254 ' 
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APPHNDIX C 
MES Staffing Pattern 
Staff for A. A. Hcnosch 



Normal 



Proposed for 
197U72 



Provided 



Administration 
Principal 

Administrative Intern 
Clerks 



Teachers 



1 (1/2 time) 

1 (full-time 
1 (1/2 time) 



1 full-time 
Assistant Principal 

3 (full-time) 



As Proposed 

1 Adminis- 
trative In- 
tern 

2 (full-time) 



Homeroom Teachers 
Kindernarten Teachers 
Child . 

Development 
Special Fiducation 

Teachers 
Cluster Teachers 



13 
2 



1 
0 



Permanent Substitute 
Teacher 0 

Permanent Cluster 
Substitute 0 



Special Subject Teachers 

Art Teaclier 
Physical Ud. Teacher 

Vocal Music Teacher 
Instrumental Music 
Teacher 

Handicraft Teacher 
Science Teacher 

Aides 



Teacher Assistants 



2 days /week 

3 days/week 

2 days/week 



19 
2 



8-1 for K-(4 1/2-day classes) 
1 for Listening Post and 

Specials (2 classes) 
1 for Gr. 1 (3 classes) 
1 for Grs. 15 2 (3 classes) 
1 for Grs. 2 fi 5 (3 classes) 
1 for Grs. 3 fi 4 (3 classes) 
1 for Grs. 4 f, 3 (3 classes) 
1 for Grs. 5 5 6 (3 classes) 



2 
2 



As Proposed 
ti 



ft 
II 



As Proposed 



S days /week 
1 for S days/week 
1 for 1 day/week 

5 days /week 



11/2 days/week 
2 days/week 
5 days /week 



1 for Childhood 
Development 



11/2 days/week 
2 days /week 
S days/week 



14-1 Pre-Kindergarten 

2 for K (4 1/2-day classes) 
I for every i classes in 

Grades f.<) (10) 
1 for Science and Art 



tt 
tf 

ti 

tf 
tt 
tf 



ff 
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Staff Cateciorv 



APPENDIX C (Continued) 
Staff for A. A. Benesch • Continued 



Nornal 



Proposed for 
1971-.72 



Provided 



Aides->Continued 

Community Aide 
Shower Attend.int 
Nutrition Aides for 
BrOfikfast Progr.ini 



Supportive Service 

Guidance Counselor 
Speech Thertipist 
Psycholof.ist 



0 
1 



0 

1 1/2 days/week 
1 day/nonth 



7 (funded under 
Nutrition ProRram) 



llomc«Curriculun Specialist 0 



1 (full-time) 

2 1/2 days /week 
2 days/month 

1 (full-time) 



As Proposed 
It 



It 
II 
It 
It 



Medical Services 



Doctor 

Nurse 

Dentist 

Dental Hygienist 



1/2 day /month 
1 1/2 days/u'eek 
1/2 day/month 
1 1/2 days/week 



1/2 day/month 
1 1/2 days/week 
1/2 day/ji)onth 
1 1/2 days/week 



It 
It 
It 
It 



Library Services 



Libraritin 
Library Aide 



It 
It 
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Staff Catcr^ory 



Normal 



APPENDIX C (Continued) 

Staff for Wooldridge 

Proposed for 
1971-72 



Provided 



Administration 

Principal 1 

Administrative Intern 0 

Clerk 1 



1 
1 

2 



As Proposed 
II 



Tcacliers 

Homeroom Teachers 
Kindergarten Teachers 
Special Kducation Teachers 

Child Developnent 
Teacher 

Permanent Substitute 
Cluster Teachers 



Special Subject Teachers 

Science Teacher 
Art 

Vocal Music 
Instrumental Music 
Physical Education 



2 days/xveek 
2 days/week 
2 days/week 
11/2 days/week 
2 days/week 



9 
1 
2 

1 

2 
3 



- 1 for Grs, 1 5 2 
(3 classes) 

1 for Grs. 3 § 4 
(3 classes) 

1 for Grs, 4, 5 P, 
(3 classes) 



days /week 
days/week 
days /week 
1/2 days/week 
days/week 



Aides 



Teacher Assistants 

Nutrition Aides for 
Breakfast Program 

Lundi Attendant 

Child Development 
Project Aides 

Community Aide 



0 

3 

1 
1 



(1 for every 2 
classrooms) 
(funded under 
Nutrition Program) 



II 
II 



ERIC 
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APPliNDIX C (Continued) 
Staff for Wooldridge - Continued 



Staff Category 



Nomal 



Proposed for 
197U72 



Provided 



Supportive Services 

Guidance Counselor 
1 iom e-Cur r i cu 1 urn 

Specialists 
Speech Therapist 
Psychologist 



0 

1 day/week 
1 day/month 



1 (full-time) 

1 (full-time) 

2 1/2 days/week 
2 days/r.onth 



As Proposed 

1 day/week 
As Proposed 



Medical Services 

Nurse 

Doctor 

Dentist 

Dental Hygienist 



1 1/2 days /week 
i day/nonth 
1 day/nontli 
1/2 day/week 



1 1/2 days/v;eek 
1 day/ir.onth 
1 day/nonth 
1/2 day/week 



tt 
ti 
tt 
11 



Librar)^ Service 

Librarian 1 2 1 librarian 

1 visual 
literacy 
teacher 

Library Aide 1 2 As Proposed 
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APPENDIX D 
Rating Scale Used by Classrroni Observers 



NOTE: Percentages listed in the summaries refer to percentages of 

observations, not percentages of classrooms observed. Therefore 
classrooms may be counted more than once in the percentages listed. 
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Appendix D Continued 

MORI: KFFhCTIVi: SC!!GO!,S 
IndividiKtl Class Observruion Rcpo-t 



Clevclajid Public i;c!ioo)s 
Research and Dcvclonncrit 
March, 1972 



[In.liA.SL 



IVvKT A 



School 



Ob s Clever 



i 



A ♦ Approximate number a£ children in classroom 
Content of activity observed. 



in group observed 



MliS - 19.36 
Control ^ 27.82 



MHS - 11.6 
Control- 19.06 



Who? 











MHS 


Control 


1. 


Regular classroom teacher 




Repular Teacher Alone 


35^ 


80% 


2. 


'•Cluster teacher" 




Cluster Teacher Alone 


2% 


0 


3. 


Teacher aide 




Special Staff Alone 


7% 


7% 


4. 


Special staff. Indicate who: 




2 or more Professionals 


17% 


3% 


s. 


Others (v.»ho) 




1 professional and aide 


27% 


10% 








2 or more professionals 












and aide 


12% 


0 


low 


many staff were working on the 


lesson? 












MKS 


Control 


1. 


Regular classroom teacher 


Regular Teacher Alone 


67? 


88% 


2. 


"Cluster teacher" 


Cluster Teacher Alone 


8% 


0 


3. 


Teacher aide 


Special Staff Alone 


6% 


4% 


4. 


Special STaff. Indicate who: 


7 


or more professionals 


7% 


0 


s. 


Others (who) 




professional and aide 


11% 


8% 


f 






or more professionals 












and aide 


9% 


0 



E. If a teacher assistant was present, how was she being used? 



1. Clerical assistant (grading papers, passing out 
materials, arranging bulletin board, etc.) 

2. Assisting children at their seats while teacher 
presents lesson. 

3. Working with small group 

4. Tutoring on a one-to-one basis 

5. Standing around or used chiefly as 
disciplinarian 

6. Other 

F. Define the student population relative to the cluster. 

1. Class was intact with all children present. 

2. Some children were out in a different room 
with another teacher 

3. Some children in the class were from another 
class in the cluster 

4c Not Applicable 



MHS 


Control 


22% 


. 21% 


14% 


14% 


41% 


21% 


15% 


43% 


4% • 


0 


4% 


0 



wr.s 


Control 


53? 


■75% 


28% 


10% 


18 


0 


5% 


15% 



G, '..as there more than one activity goinf, on in the classroom at the same 
tine? 

Yes No 

riES 'TFi MES - 28% 

Control - 47% Control - 52% 
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iTidivic'ual Cl:'<->r. Ob.so4rvatio:> I'.c-,)ort 



po NOT n.M'.ic Tii!-;'.i-. i'ACiiS. USH A::'^::i.v. sniiHT. 



Were "learninn stations" ovident in the classroon? 


a. Yes 




b. No 




>!ES - 


84«<, 


^^p.s - 16% 




Control - 


5.Vi 


Control - 47% 



What amount of planning and organization was evide nt in this n^^w*s activi ty? 



a. Activity was exceptionally well-orpanizcd 
and planned. 

b. Activity was above average in organization 
and planning 

c. Average organization and planning 

d. Below average in organization and planning 

e. Little or no organization and planning 
evident 



MBS 


Control 


9% 


5% 


41% 


25% 


38% 


62% 


12% 


6% 


0 


2% 



How would you chavacleri/C. the level of creativity and irmigination on 
the part of Die teacher? 

a, nxfrcnely creative 
b Moderately creative ^ 

c. Aver a fie 

d. So;:icwhat stereotyped 
Very uncreative aud stereotyped 



MES 


Control 




1% ■ 
1% 


56% 


74% 


10% 


11% 


10% 


12% 



If you rat.ul the lesson as "moderately" or "extremely creative," pJcasc 
explain the basis £or rating ^ 



To what extent did the teacher encourage independence of thought, 
interpretation and conclusion on the part of the children? 



ae Free expression of childrens* ideas was con- 
sistently encouraged and accepted 

b. Free expression of ideas was accepted but 
not particularly encouraged 

c. Expression of childrens* ideas was 
tolerated but emphasis was on "canned" 
responses 

d* Regurgitation of "facts" was the rule; expression 
of childrens* own ideas was discouraged 



a. Consistent opportunities for child to relate 
lesson to his own experience and/or bring 
experience to lesson 

b. Sone opportunity for child to relate lesson to 
his experience and use experience in lesson 

c. Lesson was remote from the child^s experience 
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MHS 


Control 


40% 


22% 


26% 


32% 


23% 


24% 


11% 


21% 


It in this 


lesson? 


Mi;s 


Control 


20% 


15% 


62% 


51% 


17% 


33% 



• 



AppcnJix n Continued 



children? 

a. Object of the lesson v«is very clear. Children 
knew what was expected, 

b. Object of the lesson v;as fairly clear, but not 
entirely — soiae children didn't understand what 
the teacher was tryinr to accomplish. 

c. Object of the lesson was Huddy, Most children 
were confused and didn't know what the teacher 
was trying to accomplish. 



lesson 


clcnr to t!»e 


MHS 


Control 


64% 


63% . 


28% 


31% 


7% 


5% 



To what extent did the teacher use a variety of methods and materials in 
l\er approach to a concept or task? 



Great variety used, concept approached from 
, several annles 
iL Some variety used 

c. Little variety used 

d. No variety 



MKS 


Control 


17% 


11% 


39% 


35% 


31% 


41% 


12% 


14% 



TakiuR into consideration the tcachinf. aids available, (|;a^Jcs, audio- 
vii;ual equipi;.cnt, charts, i:anipulativ'j5, cacj, to what extent \;ere 
teaching aids utilized? 







MKS 


Control 


a. 


Wide variety used 






b. 


Some used 


46% 


38% 


c. 


Little or no uie of tcachi)!g nids 


35% 


57% 



10. How effectively were these teachinn aids utilized? i * 

MRS Control 

a. Use was very effective iVi 13% 

b. Soinc\;J\at effective 49% 68% 

c. Ineffective 19% 18% 

11. (Answer for MES schools only) 

To what extent could the proup activity observed have been carried through 
with a class size of 30-35? 









a. 


Larger group size would have completely 






destroyed effectiveness 


22% 


b. 


Larger group size would have seriously 






impeded effectiveness 


37% 


c. 


Activity would have been somewhat less effective 






in a larger group 


30% 


d. 


Activity would have been just as effective in a 






larger group 


9% 



12. How would you rate teacher*s adaption of response and materials to the 
nuiibcr of students in the group? 



a. Uxcellent adaption to group size 

Vet JVC cff;jrtr r.ndc tc utilinr 2'''' l": 
Sono effort rtaJe to adapt to group si -.v.* 
d# Little or no effort iniule to adapt to group size 



^ffis 


Control 


22% 


13% 




40% 


25% 


33% 


13% 


13% 



ERIC 
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Appendix D Continued 



13, ^'^^ {^l»ility proi;pin<; cinploycu in the cl;i.ssrno:i? (Tnkc into account v;hothcr 
sonc children from the clas5 arc out of the roon with another teacher). 







MRS 


Control 


a. 


Yes 


721" 


51^. 


b. 


Xo 


27% 


49% 



14. Hov<? would you rate the nnount of natorin) covcrod? 









Control 


a. 


OutstnndinR 


IT 


■ ■ 


b. 


Hotter tlian average 


28% 


22% 


c. 


Aver.np.e 


56% 


62% 


.d. 


IJelov; avoranc 


14% 


12% 


e. 


Hxtrcncly poor 


I) 


0 



IS. If more than one staff member was workinn in the classroom, how effective 
• was the organization and use of personnel in the classroon? 



a. Very effective distribution of tasks juaonR 

staff in classroom 
b* Moderately effective distribution of tasks 

amon;t staff 
c. Poor distribution of tasks 



flHS 


Control 


49% 


27% 


38% 


41% 


12% 


31% 







Ml!i; ■■ 


Control 


a. 


Out standi np 




4% 


b. 


hotter than averapc 


33% 


32% 


c. 


AvcrnRc 


42% 


53% 


d. 


Uclov; averar.o 


17% 


10% 


c. 


nxtrcmely poor 


1% 


0 



17^ How.\\»ould you r^'te the lesson you have just seen^ considering the 







MKS 


Control 


a. 


Outstand5nc! 


IX 


3% 


b. 


Better tlian average 


40% 


35% 


c. 


Average 


34% 


40% 


d. 


Helow fiverai'.e 


18% 


19% 


c. 


Extremely poor 


1% 


0 



18* '5^^'' v:ould you rate the activity you have just seen, considering the 
children's Sntcvo^.t and cnthusiasr/? 



a. Outstanding 

b. Hetter than average 

c. Average 

l;xlrei.»ely poor 



MBS 


Control 


To?" 


9% 


37% 


26% 


35% 


47% 


15% 


12% 


1% 


3'; 
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A])rGndix 1) Continued 



a. Opportunities consistently available and 
participation encouratted 

b. Opportunities available but participation 
not particularly encouraged 

c. PcK opportunities available but participation 
not discouraged 

d. 1-cw opportunities available and participation 
discourajted 

hliat was the overall particjp r'tio n of child ren? 

a, Kvcry or alnont cvoi\v child uns actively involved 

b. More, than haJf the clns? pan icipiJtcd 

c. About Jialf of the children part:icii)ntcd 

d, Ltjss vli;:n half of the children narti':^ : ,ucd 
c. Tow chU 'ror participated in the Jcssoj) 



MRS 


Control 


63% 


47% 


20% 


19% 


11% 


26% 


4% 


6% 



MES 


Control 


56% 


30% 


22% 


30% . 


11% 


22% 


7% 


13% 


■ 3% 


4% 



2). When a;)proprinte, to \:hvt extent did the teacher encourage interaction 
a?Jong the students in tcachinjj ihc Icsr.on, 



a. Iv.teraction vas consistently encourat^.cd and accented. 
b» Interact? on v:as accepted :.ut not particularly Cuvouvaj'cd 
c. Occassional interaction lolcratcd, but c?Mphasis was on 

rcspon*jin;! to thct t'^achcr 
il. Interaction Ji3coura;:od or fi'owncd upoa 



MHS 


Control 




n 


25% 


37% 


28% 


41% 


9% 


14% 



22. Hov; pjciny childrf»n volunt erred in rcspo!i< 



^. HvcTy or almost every child 

b. More than half the children 

c. About half the children 
Less tha: half the children 

c, Vory few or no voliniicerinr. 



f- to trr- 




Kicr " 


"'OontroT'* 




25". 


38% 


19% 


16% 


27% 


14% 


17% 


9% 


11% 



ons? 



23 • many children raised spontf^ncons qt ?cstj ons or coTOients? 

a. Hvory or alriost every child 

b. More than half the children 
About half the children 

d. Less than half the chil'hen 

c. Very few or no children raised spontaneous questions 



MES 


Control 


3% " 


14% 


5% 


12% 


12% 


24% 


20% 


47% 


59% 



24. 



spontaneous q:iostionf 



a. 
b. 
c. 



Questions wore welconod and built on 
Questions were answered cursorily 
Questions wore if.nored 
Questions \;erc repressed 



MF.S 


Control 




52% 


39% 


38% 


6% 


5% 


11% 


3% 
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Appendix f) Continued 



How would you rntc tlic teacher's vcr b;il co^ '''inicrt jon \ \ih the children? 



a. Hxccllont 

b. Better than nvcmjje 
Avcraj^c 

He lot; average 
0^ Hxtnir.cly poor 



MliS ■ 


Control 




6% 




40% 


27% 


38% 




15% 


2% 


0 



Would you characterize the activity, movement and noi se in the clas.sroon 
as: 

a* Chaotic 

Quite noisy and active but all as part of 

Icaminf, activities 
c» A busy hum 

Like a cr>T>t, controlled 





Control 


1^ 


b\ 


28% 


16% 


51% 


49% 


14% 


28% 



How vould you rntc the dcjiree of individunJ attention nivcn the stu^'cnts 
by tJio tonchcr? 



a. Oitl.str4;tdin« 

b^ Better tliaa Average 

Average 
J Below avcrai^e 
^* nxtrcncJy poor 



MKS 


Control 


TtC 


0 


37% 


26% 


32% 


48% 


12% 


25% 


1% 


0 
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Appendix M - Teacher Oucstionnairo 



Cleveland Public Schools 
Division of Pvcsearch 

and Deveiopncnt 
May, 1972 



TO: Teachers in More Effective Schools 

FROM: Derek B. Taylor, Division of Resouixh and Developnent 
RE: tvaluation of MUS Program 

As you know we have been monitoring the progress of the MKS proprara 
since September. An iYnportant part of this effort is tiie observations and 
judyir.cnts nade by teachers participating in the pro{;ran. This questionnaire, 
which is beinj: sent to all iiiiS teachers, v;ill "ive you an opportunity to 
express your reactions to the- prof^ran. In coinpletint' it, please be absolutely 
frank about your feclinj^s, for only throuj-.h an honest appraisal of the 
program can steps be tai;en to insure its success. The questionnaire may be 
completed anon>T..ously. PLIiASl: ANSi.'LR ALL Cl-liSTinNS except where inappi icr/uie- 
e.g. Speciil Subject Teachers Siiouid not answer questions relating to cluster 
operation. 

Please return the completed questionnaire via school moil to: 

^ Derek B. Taylor 

Division of Research and Development 

Room 610 

Headquarters 

If more space is needed for your answers to some of the questions, 
use the back of the page. 
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1 


• Stron<:ly <)isa?.r-*c 


2 


- Disafjrec 


3 


- Neutral 


4 


- Ap.rce 


5 


- Stro:"!;'!)' anrcc 



Appendix f: Continued 



Question 


Response 
(Circle One) 


? CoiTJnent 


i* inc puVjioses niici r,i*ais or 
the M;:S Pios;r:iP. arc 
adcnu.';toJy defined. 


1 2 3 4 5 
2% 3% 14% 63% 18% 


■ - . i ■ ■ ■ ■ ■ ■■ 


2. Ihe SwXacture ai:ii 

ornaaization of the MHS 
Pro};ran are adeciuatcly 
defined. 


1 2 3 4 5 
8% 5% 17% 61% 8% 




3. The teaciiinf! ncthodolony 
Or tiio rror^rcU is 
adequately defined. 


1 0 X A ^ 
I ^ *f O 

5% 12% 20% 57% 7% 




A. T imfl'*'s*tt1*nrifi r'v vnlo in 

the MES Pror.ra;u. 


1 2 3 4 5 
4% 5% 7% 49% 35% 


■ . — 


r 

5. The averanc MLS class 
size of 25 pupils is 
small enoupji to allow 
for the indiviuunJization 
of instruction. 


1 ,2 3 4 5 
2% 5% 16% 45% 33% 




6. I have sufficient plan- 
ning tine built into my 
schedule. 


1 2 3 4 5 
8% 10% 13% 50% 18% 


, , 


7. 1 have adequate time and 
help to handle ny record- 
kcepinp. rcsponsihilitics^ 


^ O X A K 
X ^ ^ H D 

7% 10% 14% 50% 19% 




c. My techniques and 

stratc^:iu5 for teaching 
•have changed as a result 
of the tins Prograii. 


1 2 3 4 5 
2% 16% 52% 31% 




y. I h.ive sufi: cic;»t frccdoni 
to innoval?" in ny teachinj;. 


1 2 5 4 5 
2% 3% 13% 50% 32% 





RhSPOXSh Kl:Y 

1 - Strongly dii:a2i'cc 

2 - Disagree 

3 - Neutral 

4 - Agree 

5 - Sti^onr.ly nnrcc 



AppcnJix H Continued 



Question 



10. The M!:S Program has led to 
more and ir:provca contact 
betv;een the school and 
conr.iiiunity. 



IK The frequency of discipline 
problems has decreased as a 
result of the MLS Program, 



12. My principal provides 
effective leadership in 
implementing the MtS 
Program. 



J 3* Effective Icadorship is 

provided to the MILS Prour.'jr.i 
by the Ml-S Liair.cn Teacher, 



8% 8% 41% 25% 17% 



14, Teacher involvement in 
decision making at my 
school is adequate. 



15. Teacher inputs concerning 
the content and structure 
of the MES Program have 
been used adequately. 



16, I can get teacher supplies 
when I need them. 



17, The instructional materials 
available to me are varied 
enough to allow for a wide 
range of pupil abilities. 



ERLC 



18. Provision of equipment for 
ray use is adequate. 



Response 

(Circle One) 



2% 12% 24% 40% 22% 



1 2 3 4 5 
5% 15% 42% 35% 3% 



10% 7% 21% 45% 17% 



3% 26% 19% 39% 10% 



1 2 3 4 5 
2% 10% 35% 44% 10% 



12% 15% 18% 43% 12 



2 3 4 5 
— 17% 53% 28 



2% 3% 7% 61% 27% 



Comment 
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1 - Stron<;ly disiv^roo 

2 - Disa};rcc 

3 - Neutral 

4 - Agree 

5 - Slront;ly nf^rco 



Appendix I: Continued 



Question 



Response 
(Circle One) 



Conuneiit 



19. Considering^ their training, 
the teuc;;cr aides I work 
with do an effoctive job. 



1 2 3 4 5 
2% 1% 24% 50% 21% 



20. The teacher aides I work 
with need more training* 



1 2 3 4 5 
10% 19% 19% 38% 13' 



ERLC 



21. There is adequate con- 
riumication bet;;een the 
adninist vatic n and 
teachers in my school. 



1 2 3 4 5 
10% 18% 19% 45% 8% 



:2. There is adcuu.iL:^ corrumL ca- 
tion ber.'.;ecn the teachers 
and the :!l:S Liaison Teac!;or, 



12 3 4 5 
13% 19% 31% 23% 15% 



23. There is adequate con- 
nunication ajv.ong the 
teachers in ny school. 



24. There is adequate coop- 
eration between the 
administration and the 
teaching staff in niy 
school. 



25. There is adequate 

cooperation ar,:ong tlie 
teachers in general. 



26. There is adequate 

cooperation among the 
teachers in ny cluster. 



3% 28% 20% 43% 5^ 



1 2 3 4 5 
7% 13% 22% 50% 8% 



1 2 3 4 5 
2% 13% 26% 54% 5% 



27. There is adequate coordina- 
■ tiuii ociivooa «,iiO aocivi.tio:i 
of the clusters and the 
special subject teacher. 



1 2 3 4 5 
^- 5% 9% 60% 25% 



1 2 3 4 5 
— 9% 21% 52% 18% 
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1 - vStrongly disaf;rco 

2 - DiSwiiree 

3 - Neutral 

4 - A^rce 

5_-S tron I'y ac.rec 



QuQStion 



Response 
(Citclc One) 



2f>. My clast'^r receives adequ^-^te 
ar.tcr.tion and service frt>M 
the TtlS Liaison teacher. 



29. Tepcher aides should be 
included in cluster r.:cet- 
ings, at least periodically. 



1 2 3 4 5 
16% 14% 18% 38% 14% 



1 2 5 4 5 

2% 2% 5% 54*:i 38"^ 



50. 



The c oncep t of the cluster 
is a good one. 



51. The cluster approach is 

bcinj', correctly iupleinen,ted 
in my school. 



52. THe cluster approach as 

impl cincn t^ed in ny school 
haS'^'^'Isitivc effect on 
childrens* performance. 



55. My cluster is well 
orgv'.nized. 



1 2 3 4 .5 

— 5% 39% 56^ 



1 2 3 4 5 

2% 5% 22% 40% 31% 



1 2 3 4 5 
2% — 25% 46% 28% 



1 2 3 4 5 
6% 20% 44% 30 



Appendix H Continued 



Comirent 



ERJC 



54. Our cluster mcetincs are 
valuable and accomplish 
useful noals. 



55. The Ml:S Prori^ain provided 
adequate in-service offer- 
inr.s this year. 



1 2 3 4 5 
2% 2% 16% 46% 34% 



1 2 3 4 5 
17% 33%* 27% 23% 



56. The MliS inservice has been 
effectively conducted 
this year. 



1 2 3 4 5 
3% 19% 29% 29% 19 



57. fiHS Ln-.%. :*vice craining has 
been of benefit to me. 



1 2 3 4 5 
2% 16% 42% 16% 25^^ 
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1 - Stroii;;ly disaj;rcc 

2 - Disarrou 

3 - Neutral 

4 - A^;iue 

5 - Stroiv/.ly ap.voc 



Appendix E Continued 



, Question 


Response 
(Circle One1 


Comment 


is. In-service traininj^ s];ould 
be rcciuircd for MLS 
tr-achcrs. 


1 2 3 4' 5 
10% 18% 15% 33% 25% 




39. The evaluation of the 
MI'S Pio;^;raM is being 
conducted in a fair and 
ir.partial r.'«aniier. 


1 2 3 4 5 
2% 3% 36% 47% 12% 




40. There is adequate feed- 
back to the teachers 
frow the Division of 
Research coacerning the 
results of the i^iliS 
evaluation. 


1 2 3 4 5 
3% 13% 21% 43% 20% 


« 



41. How do yod feel about the Ml-S Program now stniKls? 

29% 1. Completely positive 

53% 2. Strongly positive, but not completely 

9% 3. Slightly positive 

7% 4. Slif.htly nc^',;itive 

2% 5. Strongly negative, but not cor.pletely 

• 6. Completely negative 



42. How many free periods a week do you have" scheduled (countini; cluster meeting 

periods)? _^ No. of % of 

Do you consider this adequate? Yes J^^^— ^° ; 



Periods Teachers 



0 - 2% 
1 

2 > — 

3 - 5% 
4.2% 
5 - 79% 

6- 3% 

7- 4% 

8- 2% 



'0 



ERIC 
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Appendix I: Continued 



43« Plca:!c C3li:nate \:hat ])erconta(;c of your ty picr.l school week is 
spent in each ol* the l'ollov;ir»ji activities^ 



Activicy 


Tcrceat of Time 


Before ^MS 


Now 


1. Teachir.g 

2. Planning 

3. Hxtra curriciilar activities 

4. Parent conferences 

5. Non-teachinn sui)ervision 
of children (e;',., hall 
duty, breakfast, etc.) 

6. Non-toaching clerical 
work 

TOTAL 


65.05, 


69.9% 


1 1 . 5'o 


16.4% 


2.7% 


3 . S'** 


4.6% 


5 « Sv 


6.9% 


1..% 


9.2^ 


3.4% 


100% 


100% 



44, Estimate the percentage of teachers in your school that really 
understand and follow the J^il:S approach. 

73.6% 

If less than lOO-o what do you feel is the effect on the program? 
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Appendix I! Continued 



45. Vihat areas of inservicc would be uiost useful to you next year? 
Please be specific. 



46. What do you consider the most valuable aspects or elements of the 
MHS Prograia? Why? 



ERIC 
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Appendix I! Continued 



47. What do you feci arc the major problems with the MES Program as it 
now stands? 



48, If you v;erc in charge of planning MHS for next year, what needs or 
changes do you feel luerit serious consideration? 



ERIC 
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Appendix I: Continued 



49. Do >ou feci the ytV.S Trogran: should bo: 

10% 1. Continued as is 

2. Continued v;ith modifications 

36% 5. i;xpji:u:cd with modifications 

4. lixpandod as is 

5. Aboli:;U:;d 

3% 6^ Undecided 



50. General Comments. 



9 
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APPENDIX P 



AchicvcTHCnt - ?ff:S vs. Control 

Adjusted flean Pre and Post Achievcn;:nt Test Scores 
for MOS and Control Sciiools at Grade 2 with 
Results of Multivariate Analysis of Covariance 



Subtest 


Mean Pre Scores 
(Covariates) 


Mean 
Post Scores 


Least 
Square 


Univariate 








MHS 


Control 




Control 


Estimate 


n 
r 


(If 




Word Meaning 


19.30 


20.50 


17.63 


15.20 


2.43 


11.21** 


1 and 


184 


Paragraph 
Meaning 


17.89 


18.25 


25.35 


23.79 


1.56 


1.55 


1 and 


184 


Arithmetic 


36.21 


36.33 














Arithmetic 
Computations 






23.20 


18.36 


4.84 


25.66*** 


1 and 


185 


Arithmetic 
Concepts 






17.53 


14.04 


3.49 


20.79*** 


1 and 


185 


PLR 


109.7 


105.2 




















Reading Multivariate F 


«s 6.24* 


2 and 


183 










Math Ntultivariate F 


= 18.21*** 


2 and 


184 



*£<.003 
**J)^<.001 
***£<. 0001 

NOTE: Analysis was performed on post test scores with pre test and PLR scores as 
covariates. Covariates shown are adjusted for unequal Post test 
scores shown are adjusted for unequal N and covariate effects • Stanford 
Primary I used as pre test and Stanford Primary II used as post test^ 

^The Stanford Primary I Achicvencnt Test r.?vcn as t:tc :>rc-t^st in Grade 2 has 
only o^ie ?i ititmctic subtcr.t. The scores from this siiL'tcnt were used as t!ie 
pro scores for the Connutnticns. Concepts and Applicnticns subtests in the 
Stanford Primary II which was given as the post test« 



ERiC 
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APPENDIX P Continued 

Achievement > ?n:S vs^ Control 

Adjusted Mean Pre and Post Achievement Test Scores 

For JtnS and Control Schools at Grade 4 
with Results of Multivariate Analysis of Covariance 



Subtest 


Mean Pre Scores 
(Covariatcs) 


Mean 
Post Scores 


Least 
.Square 


Univariate 




df 








Control 




I'ontrol 


!".stir.ate 


F 






Word Meaning 


9.9Z 


11.81 


16.86 


15.25 . 


1.61 


3.34 


1 


and 


161 


Paragraph 
Meaning 


17. 37 


18.35 


23.47 


22.39 


1.08 


.61 


1 


and 


161 


Arithmetic 
Computations 


9.79 


11.72 


18.30 


17.47 


.83 


.59 


1 


and 


160 


Arithmetic 
Concepts 


8.19 


11.46 


15.09 


12.30 


2.79 


10.17** 


1 


and 


160 


Arithmetic 
Appl^Lcations 


8.08 


9.29 


11.53 


10.32 


1.21 


1.93 


1 


and 


160 


PLR 


96.91 


96.35 








1 














Reading Multivariate F 


n 1.68 


2 


and 


160 










Math Multivariate F 


8 3.58* 


3 


and 


158 



*£<.02 
**£ <.002 



NOTE: Analysis was perfomed on post test scores with pre test and PLR scores as 
covariatcs. Covariates siiov.n are adjusted for uneo'-al N. Post test 
scores shov/n are adjusted for unequal N and covariate effects. 
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APPKNDIX r Continued 

Achievement - t3:S vs. Control 

Adjusted Mean Pre and Post Achievement Test Scores 

For Mns and Control Schools at Grade 6 
with Results of f!ultivariatc Analysis of Covariance 



Subtest 


Mean Pre Scores 
(Covnriatos) 


Mean ] 
Post Scores 


Least 
Square 


Univariate 


df 






Control 




Control 


Hstimte 


F 


Word ^feanin{; 


15.35 


. 15.49 


19.46 


17.52 


1.94 


6.77*** 


1 and 191 


Paragraph 
Meaning 


20.03 


20.50 


26.74 


25.31 


1.43 


2.01 


1 and 191 


Arithmetic 
Computations 


11.42 


12.49 


16.46 


17.95 


-1.49 


4.51* 


1 and 190 


Arithmetic 
Concepts 


9.44 


9.85 


13.89 


12.76 


1.12 


5.52*** 


1 and 190 


Ax'ithmetic 
Applications 


10.12 


11.32 


15.14 


14.08 


1.06 


2.53 


1 and 190 


PLR 


98.54 


97.05 


















Reading Multivariate F 


- 3.61** 


2 and 190 










Math Multivariate F 


« 4.95**** 


3 and 188 



*£<.04 
**£<.03 
***£<. 02 
****£<. 003 



NOTE: Analysis was performed on post test scores with pre test and PLR scores as 
covariates. Covariates shown are adjusted for unequal N. Post test scores 
shown are adjusted for unequal N and covariate effects. 



ERIC 
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APPhNDIX 
Achievement - Hoys vr.. Girls 



Adjusted Mean Pre and Post Achievement Test Scores for 
Boys and Girls at Gr.ide 2 with Results of 
Multivariate Analysis of Covariance 



Subtest 


Mean Pre Scores 
rCovariatcs) 


Mean 
Post Scores 


Least 
Square 


Univariate 








Bovs 


Girls 


iiovs 


<;irls 


l-istinate 


F 




df 


Word Meaning 


19.27 


20.53 


16.58 


16.26 


.32 


.35 


1 


and lo4 


Paragraph 
Meaning 


15.68 


20.46 


23.90 


25.23 


-1.33 


.52 


1 


and 1S4 


Arithmetic^ 


35.68 


36.86 














Arithmetic 
Computations 






19.69 


21.86 


-2.17 


5.97** 


1 


and 185 


Arithmetic 
Concepts 






15.60 


15.98 


- .38 


.18 


1 


and 185 


PLR 


104.5 


110.4 




















Reading Multivariate F = 1.18 




and 183 










Math 'Multivariate 


F = 3.00* 


2 


and 184 



*£<.052 
**£<.02 

NOTE: Analysis was performed on post test scores with prc-test scores and PLR 

scores as covariates. Covariatcs shov;n are adjusted for unequal N. Post 
test scores shown are adjusted for unequal N and covariate effects, 
Stanford Primary I used as pre-test and Stanford Primary II used as 
post test, 

• • • > . 

The Stanford Pricary I Achicver.:ont Test nivcn ns the prc-tcst in Grade 2 has 
only one arithpcric r.u^-r.cst. The scores from this subtest wore used r.s the 
pre scores for the Ccr^jutntions, tonccpcs and Aprlicatiors subtests in the 
Stanford Primary II which was given as the post test. 



ERLC 
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APPENDTX '» Continued 

Achievement * Roys vs. Girls 

Adjusted Mean Pre and Post Aciiievenent Test Scores for 
Boys and Girls at Grade 4 with Results of 
Multivariate Analysis of Covariance 



Subtest 


Mean Pre Scores 
(Co var lutes") 


^Jcaii 
Post Scores 


Square 


Univariate 










Boys 


Girls 


i-oys 


c.irls 


i-.stir. ate 


r 




df 


Viord Meaning 


11.50 


10.24 


16.28 


15.83 


.45 


1.75 


1 


and 


161 


Paragraph 
Meaning 


18.62 


17.11 


22.88 


22.98 


-.09 


1.15 


1 


and 


161 


Arithmetic 
Computations 


11.08 


10.43 


18.20 


17.57 




.72 


1 


and 


160 


Arithmetic 
Concepts 


10.22 


9.42 


14.12 


15.27 


.86 


1.94 


1 


and 


160 


Arithmetic 
Applications 


8.94 


8.44 


11.29 


10.55 


.74 


1.00 


1 


and 


160 


PLR 


94.71 


98.54 






















Reading Multivariate F 


= 1.11 


2 


and 


160 










Math Multivariate F 


= .65 


3 


and 


158 



NOTE: Analysis was performed on post test scores with pre test and PLR scores as 
covariates. Covariates shown are adjusted for unequal N. Post test scores 
shown are adjusted for unequal N and covariate effects. 
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APPRNDIX il Continued 



AchievcTnent - Boys vs. Girls 

Adjusted Mean Pre and Post Achievement Test Scores for 
Boys and Girls at Grade 6 with Results 
of Multivariate Analysis of Covariance 



Subtest 


Mean Pre Scores 
(Covariates) 


Mean 
Post Scores 


Least 
Square 


Univariate 










iiOVS 
r ■ 


Girls 


liOVS 


Ciris 


Hstirate 


F 




clf 




Word Meaning 


15.48 


15.37 


18.99 


17.99 


.99 


2.41 


1 


and 


191 


Paragraph 
Meaning 


20.12 


20.42 


25.45 


26.60 


-1.16 


.70 


1 


and 


191 


Arithmetic 
Conputations 


11.59 


12.32 


16.63 


17.78 


-1.15 


2.86 


1 


and 


190 


Arithmetic 
Concepts 


10.06 


9.23 


12.94 


13.71 


- .77 


1.02 


1 


and 


190 


Arithmetic 
Applications 


11.15 


10.30 


14.26 


14.96 


- .71 


.11 


1 


and 


190 


PLR 


97.79 


97.79 






















Reading Multivariate F = 2.09 


2 


and 


190 










Math Multivariate F = 1.45 


3 


and 


188 



NOTE: Analysis was performed on post test scores with pre test and PLR scores as 
covar •: Covariates shown are adjusted for unequal N. Post test scores 

shown are adjusted for unequal i\' and covariate effects. 
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APPENDIX I 

AchicveTncnt - Bencsch vs> Ivooldridne 

Adjusted Mean Pre and Post Achicvenent Test Scores for A. A, Benesch and 

Kooldridje Sciiools at Grade 2 with 
Results of Multivariate Analysis of Covariance 



Subtest 


Mean i're Scores 
(Covariates) 


Mean 
Post .Scores 


Least 
Square 


Uni- 
variate 








: 


Kcnesch 


i*POl(lri deo 


Bencscii 


l\ool(iricl<;e 


Hstir.-.ate 


F 








Word Meaning 


19.74 


18.87 


20.53 


14.73 


5.79 


40.11** 


1 


and 


184 


Paragraph 
Meaning 


17.31 


18.47 


27.02 


23.68 


3.34 


5.35* 


1 


and 


184 


* a 
Arithmetic* 


36.45 


35.97 
















Arithmetic 
Computations 






25.14 


21.25 


3.89 


15.25** 


1 


and 


185 


Arithmetic 
Concepts 






19.94 


15.12 


4.81 


29.14** 


1 


and 


185 


PLR 


103.7 


115.7 






















Reading Multivariate F 


= 22.44** 


2 


and 


183 










Math Multivariate F 


= 17.69** 


2 


and 


184 



*£<.03 
**£<.0002 



NOTE: Analysis v;as performed on post test scores witli pre-tcst scores and PLR scores 
as covariates. Covariates shown are adjusted for unequal N. Post test scores 
shown are adjusted for unequal N and covariate effects. Stanford Primary I 
used as pre test and Stanford Primary II used as post test. 

a 

The Stanford Prir/try I Aciiicvci::ent Tc?t riven as the pre-tcst iv. Grvdc 2 has 
only ono aril 'I*.;' tic subtest. The score; frr-nt tt:is subtest v:ore used r.r the 
pre scores for Cor»^-itpticr.5. Concerns r.;..! A'^^'lications subtests in tlie 
Stanford Primary II wtiich was given as tiie post test. 
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APPHNDIX I Continued 



Achieven:cnt - B'encsch vs^ WonUlridt:e 

Adjusted Mean Pre and Post Achievenent Test Scores for A. A. Benesch and 
Wooldridj»e Schools at Grade A with 
Results of Multivariate Analysis of Covariance 





Mean Pre Scores 
(Covariates) 


Mean 
Post Scores 


Least 


Uni- 

vnTi ill* p 










iicr.e.scli 


iooldridfe 


uenescii 


nooldriclQe 


F.stimate 


F 




df 




Word Meaning 


9.17 


10.69 


17.00 


16.71 


.79 


.96 


1 


and 


161 


Paragraph 
Meardnfj 


17.50 


17.25 


25.22 


21.72 


3.50 


7.21** 


1 


and 


161 


• Arithmetic 
Computations 


9.99 


9.58 


21.44 


15.16 


6.28 


13.34*** 


1 


and 


160 


Arithmetic 
Concepts 


8.99 


7.39 


16.70 


13.49 


3.21 


16.79*** 


1 


and 


160 


Arithmetic 
Applications 


8.72 


7.44 


11.40 


11.66 


-.26 


.19 


1 


and 


160 


PLR 


97.21 


96.61 
























Reading Multivariate F 


= 3.59* 


2 


and 


160 










Math Multivariate F 


=11.81*** 


3 


and 


158 



*£<.03 
**£<.009 
***£<. 0004 

NOTE: Analysis was performed on post test scores with pre test and PLR scores as 
covariates. Covariates shov/n are adjusted for unequal N. Post test scores 
shown are adjusted for unequal N and covariate effects. 
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APPHNPIX I Continued 



Achievement - Bcnescii vs> Wooldridtyc 

Adjusted Mean Pre and Post Achievement Test Scores for A* A* Benesch and 
k^ooldrid^e Schools at Grade 6 va.u Results 
of Multivariate Analysis of Covariance 



Subtest 


fic.m i'rc :.corcs 
(Covariates) 


Post 


Me.in 
Scores 


Least 
Square 


lini- 
v.iriate 




df 






i>encscn 


i.ooiciricirc* 


isenoscri 


.lOoluriure 


l-stinatc 


F 






Word Meaning 


16.41 


14.30 


16.83 




22.10 


-5.26 


15.36*** 


1 


and 


191 


Paragraph 
Meaning 


20.96 


19.11 


25.97 




27.51 


-1.54 


.64 


1 


and 


191 


Arithmetic 
Computations 


11.42 


11.13 


16.05 




16.87 


- .82 


1.40 


1 


and 


190 


Arithmetic 
Concepts 


10.24 


8.65 


12.21 




15.56 


-3.35 


15.98*** 


1 


find 


190 


Arithmetic 
Applications 


11.02 


9.23 


13.66 




16.62 


-2.97 


7.86* 


1 


and 


190 


PLR 


100.3 


96.79 


























Reading Multivariate F 


= 7.70** 


2 


and 


190 












Math Multivariate F 


= 6.47*** 


3 


and 


188 



<'£<.0O6 
**J)<.0OO7 
***£<. 0004 

NOTE: Analysis was performed on post test scores with pre test and PLR scores as 
covariates. Covariates snov:n are adjusted for unequal N. Post test scores 
shown are adjusted for unequal N and covariate effects. 
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APPiiXDiX J 



Attendance Data 



Means and Standard Deviations of Attendance Percentages 
from MliS Schools and City-lVide 



School 


IPrc-Prop.ram) 
1965-69 


(Year 1) 


11)70-71 
(Yoar 2) 


l!)71-72 
(Year .3) 




Mean 


s.d 


Me;in 


s.d. 


Mean 


s.d. 


^lean ' 


s.d. 


MliS 


93.34 


.96 


92.21 


2.24 


91.72 


2.06 


92.19 


1.16 


City-Wide 


94.11 


.96 


92.93 


2.07 


92.20 


2.18 


93.33 


1.49 



Independent t-tests between MHS and 
City-Wide Attendance Data 



Year 


MES vs. 


City-Wide 


t* 


df 


1965-69 




1.75 


18 


(Pre-Propran>) 








1969-70 - Year 


1 


.73 


18 


1970-71 - Year 


2 


.49 


18 


1971-72 - Year 


3 


1.91 


18 



*2-tailed test 



Correlated t-tests* on Attendance Data 
for MES Schools and City-U'ide 



Schools 


196?-()9 
(Pre-Program) 
vs • 

1971-72 (Year 3) 


1970- 71 (Year 2) 

vs. 

1971- 72 (Year .3) 




t df 


t df 


MES 


3.28*** 9 


.69 9 


City-Wide 


2.73** 9 


2.62** 9 


*2-tailcd test 
**£<.05 
***£<.005 
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APPIiNDIX K 



Form and Level of Stanford Achievenent Tests Adnini stored In 
Year 1, Year 2 and Year 3 to Pupils in the Lonaitudinal Sample, 





Lonri tudinnl Snnnlc 


Sr.nnle Size 


Level and rorm of Test 


Graiic Pronrani Year 


:T.S Control 


Post • Primary I, X 

Pre • Primary I, X 
Post - Primary II, M 


1 2 

2 3 


51 S4 


Pre • Primary I, IV 
Post • Primary II, W 

Pre • Primary II, X 
Post - Primary II, W • 

Pre • Intermediate I, X 
Post - Intermedi.ite I, W 


2 1 

3 2 

4 3 


48 58 


Pre - Inten^iediate I, X 
Post - Intermediate I, W 

Pre - Intermediate II, W 
Post • Interned] <ite II, X 

Pre - Intermediate II, X 
Post - Interncdiate II, W 


4 1 

5 2 

6 3 


33 61 
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APPKNDIX L Continued 

Achicvcncnt - MHS vs. Control Lonnitudinal Data 

Adjusted Mean Pre and Post Achievcnent Test Scores for *U;S and Control 
Children in the Longitudinal Samples with Results of 
Multivariate Analysis of Covariance 



Grade 2>3>4 



Subtest 


Mean Pre Scores 
(Covariates) 


t!ean 
Post Scores 


Least 
Square 


Univariate 










MKS 


Control 


Mt-S 


Control 


I:stinate 


V 




df 




Word Meaning 


16.46 


20.95 


17.43 


16. IC 


1.28 




I 


and 


95 


Paragraph 
Meaning 


13.25 


18.64 


24.87 


23.14 


1.73 


.69 


1 


and 


95 


Arithmetic^ 


31.09 


. 31.94 
















Arithmetic 
Computation 






17.04 


19.09 


-2.65 


3.91* 


1 


and 


96 


Arithmetic 
Concepts 






14.61 , 


14.23 


.38 


.00 


1 


and 


i/6 


Arithmetic 
Applications 






10.99 


12.52 


-1.54 


3.70* 


1 


and 


96 


PLR 


100.2 


103.2 




















Reading Multivariate 1 


• = .49 




2 


and 


94 






Math Multivariate F = 3.23*** 




3 


and 


94 



*£<.051 
**£<.057 
***£<. 026 



NOTE: Analysis was performed on Grade 4 post test scores with Grade 2 pre test and 
PLR scores as covariates. Covariates shown are adjusted for unequal N, Post 
test scores shown are adjusted for unequal N and covariate effects. 

The Stanford Primary I Achievement Test given as the pre-test in Grade 2 has 
only one arithmetic subtest. The scores from this subtest were used as the 
pre scores for the Computations, Concepts and Applications subtests in the 
Stanford Intermediate I which was given as the post test. 
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APPHNDIX 1^ Continued 



Achicvcncnt - MHS vs. Control Longitudinal Data 

Adjusted Mean Pre and Post Achievement Test Scores for ItliS and Control 
Children in the Longitudinal Sa:nples with Results of Multi* 
variate Analysis of Covariance 

Grade 4-5-6 



Subtest 


Mean I're Scores 
(Covariates) 


Mean 
Post Scores 


Least 
Square 


Univariate 




df 






MliS 


Coiitrol 




Control 


Hstinatc. 




F 






Word Mcaninp, 


9.94 


15.74 


23.69 


17.38 


6.32 




12.81*** 


1 


and 


S3 


Parapraph 
Meaning 


15.66 


17.98 


29.45 


25.28 


4.17 




3.15* 


1 


and 


83 


Arithmetic 
Computations 


9.54 


11.00 


17.31 


18.66 


-1.34 




.48 


1 


and 


82 


Arithmetic 
Concepts 


9.41 


9.79 


14.80 


13.56 


1.24 




2.59 


1 


and 


82 


Arithmetic 
Applications 


8.62 


9.19 


lh.55 


14.93 


1.62 




1.82 


1 


and 


82 


PLR 


95.61 


95.62 


























Readinp Multivariate F 


= 6.36** 


2 


and 


82 










Math Multivariate 


F 


= 1.77 


3 and 


80 



*j) <.08 
**£ <.003 
***£<. 0006 



NOTE: Analysis was performed on Grade 6 post test scores with Grade 4 pre test and 
PLR scores as covariates. Covariates shown are adjusted for unequal N. Post 
test scores shown are adjusted for unequal N and covariate effects. 
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Achicvoricnt 



APPIiKDlX L 
- ^r>:S vs» Control LorinjtxuHnnl Para 



Adjusted Mean Post Achievcncnt Test Scores for MHS and Control 
Children in the Lonjiitudinal Snnnles with Results of 
Multivariate Analysis of Covariancc 







Grade 1 


• 2 


♦ 




Subtest 


Mean 
Post Scores 


Least 
Square 


Univ.iriatc 






MliS 


Control 


listirate 


!• 


(If 


Word Meaning 


IS. 00 


16.63 


1.37 


1.08 


1 and 96 


Paragraph Meaning 


25*07 


26.68 


• 1.60 


.(■)0 


1 and 96 


Arithmetic 
Computations 


22.67 


19.08 


3.59 


5.91* 


1 and 96 


Arithmetic 
Concepts 


17.90 


15.15 


2.74 


5.44* 


1 and 96 


Metropolitan 
Readinr. Ivcadi- 
ness Test 
(Covariate) 


55.24 


59*20 












Reading Multivariate 


r = 4.23* 


2 and 9S 






Math Multivariate 


I- = 3.70* 


2 and 95 



*£<.026 



NOTR: Analysis was performed on Grade 4 post test scores with Metropolitan 
Reading Readiness Tost score as the covariate* Covariate shown is 
adjusted for unequal N. Post test scores shown are adjusted for 
unecjual N and the effect of the covariate. 
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